Monday, January 4, 2021

Digest for comp.programming.threads@googlegroups.com - 5 updates in 4 topics

Amine Moulay Ramdane <aminer68@gmail.com>: Jan 03 10:11AM -0800

Hello..
 
 
More of my philosophy about complexity and productivity and quality..
 
I am a white arab, and i think i am smart since i have invented many scalable algorithms and algorithms, and i think i am a philosopher, so i have just talked yesterday in my philosophy about the meaning and purpose of life(read my thoughts about it below), and today i will
speak more about complexity and productivity and quality..
 
So i will ask a philosophical question:
 
How to manage efficiently complexity ?
 
I think you can manage complexity by the "divide and rule" approach
to management, which also leads to hierarchical division of large organisations, or wich also leads to the Division of "labour",
you can read more about the Division of labour here:
 
https://en.wikipedia.org/wiki/Division_of_labour
 
Also you can manage complexity by using constraints, such as laws, road rules and commercial standards, all of which limit the potential for harmful interactions to occur, also you can manage complexity by
using higher layers of abstraction such as in computer programming,
and we can also follow the efficient rule of: "Do less and do it better" that can also use higher level layers of abstraction to enhance productivity and quality, this rule is good for productivity and quality, and about productivity: I have also just posted about the following thoughts from the following PhD computer scientist:
 
https://lemire.me/blog/about-me/
 
Read more here his thoughts about productivity:
 
https://lemire.me/blog/2012/10/15/you-cannot-scale-creativity/
 
And i think he is making a mistake:
 
Since we have that Productivity = Output/Input
 
But better human training and/or better tools and/or better human smartness and/or better human capacity can make the Parallel productivity part much bigger that the Serial productivity part,
so it can scale much more (it is like Gustafson's Law).
 
And it looks like the following:
 
About parallelism and about Gustafson's Law..
 
Gustafson's Law:
 
• If you increase the amount of work done by each parallel
task then the serial component will not dominate
• Increase the problem size to maintain scaling
• Can do this by adding extra complexity or increasing the overall
problem size
 
Scaling is important, as the more a code scales the larger a machine it
can take advantage of:
 
• can consider weak and strong scaling
• in practice, overheads limit the scalability of real parallel programs
• Amdahl's law models these in terms of serial and parallel fractions
• larger problems generally scale better: Gustafson's law
 
Load balance is also a crucial factor.
 
So read my following thoughts about the Threadpool to notice that my Threadpool that scales very well does Load balance well:
 
---
 
About the Threadpool..
 
I have just read the following:
 
Concurrency - Throttling Concurrency in the CLR 4.0 ThreadPool
 
https://docs.microsoft.com/en-us/archive/msdn-magazine/2010/september/concurrency-throttling-concurrency-in-the-clr-4-0-threadpool
 
 
But i think that both the methodologies from Microsoft of the Hill Climbing and of the Control Theory using band pass filter or match filter and discrete Fourier transform have a weakness, there weakness is that they are "localized" optimization that maximize the throughput
, so they are not fair, so i don't think i will implement them, so then you can use my following invention of an efficient Threadpool engine with priorities that scales very well (and you can use a second Threadpool for IO etc.):
 
https://sites.google.com/site/scalable68/an-efficient-threadpool-engine-with-priorities-that-scales-very-well
 
And here is my other Threadpool engine with priorities:
 
https://sites.google.com/site/scalable68/threadpool-engine-with-priorities
 
 
And read my following previous thoughts to understand more:
 
About the strategy of "work depth-first; steal breadth-first"..
 
I have just read the following webpage:
 
Why Too Many Threads Hurts Performance, and What to do About It
 
https://www.codeguru.com/cpp/sample_chapter/article.php/c13533/Why-Too-Many-Threads-Hurts-Performance-and-What-to-do-About-It.htm
 
Also I have just looked at the following interesting video about Go scheduler and Go concurrency:
 
Dmitry Vyukov — Go scheduler: Implementing language with lightweight concurrency
 
https://www.youtube.com/watch?v=-K11rY57K7k
 
And i have just read the following webpage about the Threadpool of microsoft .NET 4.0:
 
https://blogs.msdn.microsoft.com/jennifer/2009/06/26/work-stealing-in-net-4-0/
 
 
And as you are noticing the first web link above is speaking about the strategy of "work depth-first; steal breadth-first" , but we have to be more smart because i think that this strategy, that is advantageous for cache locality, works best for recursive algorithms, because a thread is taking the first task and after that the algorithm is recursive, so it will put the childs tasks inside the local work-stealing queue, and the other threads will start to take from the work-stealing queue, so the work will be distributed correctly, but as you will notice that this strategy works best for recursive algorithms, but when you you iteratively start many tasks, i think we will have much more contention on the work-stealing queue and this is a weakness of this strategy, other than that when it is not a recursive algorithm and the threads are receiving from the global queue so there will be high contention on the global queue and this is not good. MIT's Cilk and Go scheduler and the Threadpool of Microsoft and Intel® C++ TBB are using this strategy of "work depth-first; steal breadth-first". And as you are noticing that they are giving more preference to cache locality than scalability.
 
But in my following invention of a Threadpool that scales very well i am
giving more preference to scalability than to cache locality:
 
https://sites.google.com/site/scalable68/an-efficient-threadpool-engine-with-priorities-that-scales-very-well
 
Other than that when you are doing IO with my Threadpool, you can
use asychronous IO by starting a dedicated thread to IO to be more efficient, or you can start another of my Threadpool and use it for tasks that uses IO, you can use the same method when threads of the my Threadpool are waiting or sleeping..
 
Other than that for recursion and the stack overflow problem
you can convert your function from a recursive to iterative
to solve the problem of stack overflow.
 
Other than that to be able to serve a great number of internet connections or TCP/IP socket connections you can use my Threadpool
with my powerful Object oriented Stackful coroutines library for Delphi and FreePascal here:
 
https://sites.google.com/site/scalable68/object-oriented-stackful-coroutines-library-for-delphi-and-freepascal
 
---
 
And enhancing productivity is also related to my following powerful product that i have designed and implemented(that can also be applied to organizations):
 
https://sites.google.com/site/scalable68/universal-scalability-law-for-delphi-and-freepascal
 
Please read the following about Applying the Universal Scalability Law to organisations:
 
https://blog.acolyer.org/2015/04/29/applying-the-universal-scalability-law-to-organisations/
 
Yet more philosophy about quality control and quality..
 
So first you have to define quality(read below about it) and second
you have to construct quality and third you have to control quality.
 
So, I have just read the following about the Central Limit Theorem
(I understood it), i invite you to read it carefully:
 
https://www.probabilitycourse.com/chapter7/7_1_2_central_limit_theorem.php
 
 
So as you are noticing this Central Limit Theorem is so important
for quality control, read the following to notice it(I also understood Statistical Process Control (SPC)):
 
An Introduction to Statistical Process Control (SPC)
 
https://www.engineering.com/AdvancedManufacturing/ArticleID/19494/An-Introduction-to-Statistical-Process-Control-SPC.aspx
 
Also PERT networks are referred to by some researchers as "probabilistic activity networks" (PAN) because the duration of some or all of the arcs are independent random variables with known probability distribution functions, and have finite ranges. So PERT uses the central limit theorem (CLT) to find the expected project duration.
 
So, i have designed and implemented my PERT++ that that is important for quality, please read about it and download it from my website here:
 
https://sites.google.com/site/scalable68/pert-an-enhanced-edition-of-the-program-or-project-evaluation-and-review-technique-that-includes-statistical-pert-in-delphi-and-freepascal
 
---
 
 
So I have provided you in my PERT++ with the following functions:
 
 
function NormalDistA (const Mean, StdDev, AVal, BVal: Extended): Single;
 
function NormalDistP (const Mean, StdDev, AVal: Extended): Single;
 
function InvNormalDist(const Mean, StdDev, PVal: Extended; const Less: Boolean): Extended;
 
For NormalDistA() or NormalDistP(), you pass the best estimate of completion time to Mean, and you pass the critical path standard deviation to StdDev, and you will get the probability of the value Aval or the probability between the values of Aval and Bval.
 
For InvNormalDist(), you pass the best estimate of completion time to Mean, and you pass the critical path standard deviation to StdDev, and you will get the length of the critical path of the probability PVal, and when Less is TRUE, you will obtain a cumulative distribution.
 
 
So as you are noticing from my above thoughts that since PERT networks are referred to by some researchers as "probabilistic activity networks" (PAN) because the duration of some or all of the arcs are independent random variables with known probability distribution functions, and have finite ranges. So PERT uses the central limit theorem (CLT) to find the expected project duration. So then you have to use my above functions
that are Normal distribution and inverse normal distribution functions, please look at my demo inside my zip file to understand better how i am doing it:
 
You can download and read about my PERT++ from my website here:
 
https://sites.google.com/site/scalable68/pert-an-enhanced-edition-of-the-program-or-project-evaluation-and-review-technique-that-includes-statistical-pert-in-delphi-and-freepascal
 
 
More of my philosophy about Niklaus Wirth and about the good taste..
 
Having good taste involves knowing what is truly excellent or of genuine value.
 
Read here to notice it:
 
What Is Good Taste?
 
https://www.3quarksdaily.com/3quarksdaily/2014/03/what-is-good-taste.html
 
And as you have just noticed i have just posted the following thoughts
of Niklaus Wirth (https://en.wikipedia.org/wiki/Niklaus_Wirth):
 
https://groups.google.com/g/alt.culture.morocco/c/h_xKwu2gM44
 
And i think that Niklaus Wirth is too pessimistic on the above thoughts
Since you have to know that an efficient education can permit to give you a good taste so that to be able to be efficiently selective, and this is valid for both the consumers and the producers of products or services.
 
And more of my philosophy about the good taste..
 
So let us look in the dictionary at what is the taste, it says the following:
 
"The taste is the sense by which the qualities and flavour of a substance are distinguished by the taste buds."
 
Read here in the dictionary to notice it:
 
https://www.collinsdictionary.com/dictionary/english/taste
 
But when you are smart you will also notice that there is also
the intellectual taste from culture or genetics, i mean that
when you are genetically more rational and more smart you will notice that this more rational and more smart is also intellectual taste since with it you are able to be more efficiently selective of your knowledge, so it permits you to enhance quality, and this is also the same for culture, i mean when you enhance more your culture it enhances your intellectual taste and it permits you to be more efficiently selective of your knowledge, so it permits you to enhance quality.
 
So as you are noticing that the intellectual taste is so important..
 
 
More of my philosophy of what is happiness and pleasures of life..
 
I am a white arab, and i think i am smart since i have invented many scalable algorithms and algorithms, and i think i am a philosopher, so i will ask a philosophical question:
 
From where comes happiness and pleasures of life?
 
It is like beauty of the alternance of the day and night, from
this alternance of the day and night comes beauty and a kind of pleasure, so i think that happiness comes from this kind of alternance, i mean that for example you will get a great pleasure from eating a Moroccan Couscous Bidaoui(read about it below) when you are hungry, so from this alternance of being hungry and eating a Moroccan Couscous comes this great pleasure of life that gives happiness and that gives
the meaning of life, so you have to know how to be this alternance
, i mean when for example you work hard and after that you give
yourself peace by taking a rest and you also give yourself a pleasure like eating a Moroccan Couscous Bidaoui, you will get a great pleasure, so you have to know how to be this alternance of being hard work and giving yourself peace by taking a rest, this is from where comes happiness and this is from where comes the meaning of human existence,
read all my following philosophy to understand more:
 
More of my philosophy about pleasures of life..
 
As you have noticed i have talked before about the meaning and purpose of life (read below my thoughts)..
 
And here is more explanation of what i was saying about pleasures of life:
 
101 Simple Pleasures to Boost Happiness
 
According to Gretchen Rubin, author of The Happiness Project and Happier at Home. "It's not life changes like a new house or a fancy car that make the most impact, but sometimes little things like the smell of an orange, that give the biggest happiness boost," says Rubin.
 
Read more here:
 
https://www.huffpost.com/entry/simple-pleasures_b_3038326
 
 
More philosophy about do we have to measure it relatively or absolutely..
 
When you measure an IQ , you can measure it relatively to the distribution of other IQs, but is it the right measure? so this question is really important, since the philosopher Albert Camus was measuring the meaning and purpose of life by measuring it like absolutely by saying that human existence is absurd by saying:
 
"Absurdism arises out of the tension between our desire for order, meaning and happiness and, on the other hand, the indifferent natural universe's refusal to provide that."
 
But i think this is a mistake, since in my philosophy i am measuring
the meaning of human existence "relatively" to pleasures of life that
are like "powerful" drugs that bring us more happiness and so they give meaning to human existence(since they are like powerful drugs) and they permit us to go forward towards more and more perfection and this going forward towards more and more perfection is also the goal of morality(read below my political philosophy about morality so that to understand it), so i think i am right by saying so, so then human existence is not absurd.
 
More political philosophy about morality..
 
I think i am a philosopher, so i think that so that to love
morality, you have like to love playing smartly at a game of chess,
morality is like playing smartly at a game of chess, morality is smartness in action, and being this smartness in action gives pleasure
, it is a pleasure of human life that gives meaning to human existence, so you have to love morality since smartness is an important thing and it gives also hope and it gives pleasure that gives meaning to human existence.
 
More political philosophy about pleasures
Bonita Montero <Bonita.Montero@gmail.com>: Jan 03 07:51PM +0100

According to your _tiny_ algorithmis which were invented before
you have never dealt with complexity.
Amine Moulay Ramdane <aminer68@gmail.com>: Jan 03 09:10AM -0800

Hello..
 
 
How to Make Artificial Intelligence More Democratic
 
A new type of learning model uses far less data than conventional AIs, allowing researchers with limited resources to contribute.
 
Read more here:
 
https://www.scientificamerican.com/article/how-to-make-artificial-intelligence-more-democratic/
 
 
Thank you,
Amine Moulay Ramdane.
Amine Moulay Ramdane <aminer68@gmail.com>: Jan 03 06:49AM -0800

Hello..
 
 
 
Read again, i correct a typo on my poem in english..
 
Here is my new poem: "I dance so well on this Latino music!"
 
Here is my poem that i just translated from my poem in french(read it below), read it while listening to the following beautiful song:
 
https://www.youtube.com/watch?v=aW53FISpAUc&list=OLAK5uy_n3TtJlYJEy7f8bZMCjK0SWKHc_PdrgVy0
 
Here is it is:
 
---
 
I dance so well on this Latino music!
 
And I eat healthy organic food!
 
I dance so well on this Latino music!
 
Since notice my pretty english that I write to you with my pen!
 
I dance so well on this Latino music!
 
And I play well at life as one plays well at the games of Dominoes!
 
I dance so well on this Latino music!
 
And I am rich of my poetry without going to play at the Casino!
 
I dance so well on this Latino music!
 
And my words also make pretty kisses on such friendly tunes!
 
I dance so well on this Latino music!
 
And my lovely love for you is not these hospital patients!
 
Because I dance so well on this Latino music!
 
So am I an inhabitant of Havana or Santiago?
 
Because my love for you is like such a beautiful Angel coming to us from up there!
 
---
 
 
Voici mon nouveau poème en français:
 
Lisez-le en écoutant la jolie chanson suivante:
 
 
https://www.youtube.com/watch?v=aW53FISpAUc&list=OLAK5uy_n3TtJlYJEy7f8bZMCjK0SWKHc_PdrgVy0
 
 
Le voici:
 
 
Je danse si bien sur cette musique Latino !
 
Et je mange santé joliment en bio !
 
Je danse si bien sur cette musique Latino !
 
Puisque remarque mon joli français que je t'écris avec mon stylo !
 
Je danse si bien sur cette musique Latino !
 
Et je joue bien à la vie comme on joue bien au jeux des Dominos !
 
Je danse si bien sur cette musique Latino !
 
Et je suis riche de ma poésie sans aller jouer au Casino !
 
Je danse si bien sur cette musique Latino !
 
Et mes paroles aussi se font des jolies bises sur des airs si amicaux !
 
Je danse si bien sur cette musique Latino !
 
Et mon si joli amour pour toi n'est pas ces malades des hôpitaux !
 
Car je danse si bien sur cette musique Latino !
 
Alors suis-je un habitant de la Havane ou de Santiago ?
 
Car mon amour pour toi est comme un si bel Ange qui nous vient de là-haut !
 
 
 
Merci,
Amine Moulay Ramdane.
Amine Moulay Ramdane <aminer68@gmail.com>: Jan 03 06:44AM -0800

Hello..
 
 
Here is my new poem: "I dance so well on this Latino music!"
 
Here is my poem that i just translated from my poem in french(read it below), read it while listening to the following beautiful song:
 
https://www.youtube.com/watch?v=aW53FISpAUc&list=OLAK5uy_n3TtJlYJEy7f8bZMCjK0SWKHc_PdrgVy0
 
Here is it is:
 
---
 
I dance so well on this Latino music!
 
And I eat healthy organic food!
 
I dance so well on this Latino music!
 
Since notice my pretty english that I write to you with my pen!
 
I dance so well on this Latino music!
 
And I play well at life as one plays well at the games of Dominoes!
 
I dance so well on this Latino music!
 
And I am rich of my poetry without going to play at the Casino!
 
I dance so well on this Latino music!
 
And my words also make pretty kisses on such friendly tunes!
 
I dance so well on this Latino music!
 
And my lovely love for you is not these hospital patients!
 
Because I dance on well to this Latino music!
 
So am I an inhabitant of Havana or Santiago?
 
Because my love for you is like such a beautiful Angel coming to us from up there!
 
---
 
 
Voici mon nouveau poème en français:
 
Lisez-le en écoutant la jolie chanson suivante:
 
 
https://www.youtube.com/watch?v=aW53FISpAUc&list=OLAK5uy_n3TtJlYJEy7f8bZMCjK0SWKHc_PdrgVy0
 
 
Le voici:
 
 
Je danse si bien sur cette musique Latino !
 
Et je mange santé joliment en bio !
 
Je danse si bien sur cette musique Latino !
 
Puisque remarque mon joli français que je t'écris avec mon stylo !
 
Je danse si bien sur cette musique Latino !
 
Et je joue bien à la vie comme on joue bien au jeux des Dominos !
 
Je danse si bien sur cette musique Latino !
 
Et je suis riche de ma poésie sans aller jouer au Casino !
 
Je danse si bien sur cette musique Latino !
 
Et mes paroles aussi se font des jolies bises sur des airs si amicaux !
 
Je danse si bien sur cette musique Latino !
 
Et mon si joli amour pour toi n'est pas ces malades des hôpitaux !
 
Car je danse si bien sur cette musique Latino !
 
Alors suis-je un habitant de la Havane ou de Santiago ?
 
Car mon amour pour toi est comme un si bel Ange qui nous vient de là-haut !
 
 
 
Merci,
Amine Moulay Ramdane.
You received this digest because you're subscribed to updates for this group. You can change your settings on the group membership page.
To unsubscribe from this group and stop receiving emails from it send an email to comp.programming.threads+unsubscribe@googlegroups.com.

No comments: