summaryrefslogtreecommitdiff
path: root/lib/git/async/util.py
Commit message (Collapse)AuthorAgeFilesLines
* test implementation of async-queue with everything stripped from it that ↵Sebastian Thiel2010-06-081-5/+48
| | | | didn't seem necessary - its a failure, something is wrong - performance not much better than the original one, its depending on the condition performance actually, which I don't get faster
* Task scheduled items lock now uses a dummy lock in serial mode, improving ↵Sebastian Thiel2010-06-071-1/+13
| | | | | | its performance considerably. Channels now use the AsyncQueue, boosting their throughput to about 5k items / s - this is something one can work with, considering the runtime of each item should be large enough to keep the threads busy. This could be a basis, further testing needed
* introduced a new counter keeping track of the scheduled tasks - this prevent ↵Sebastian Thiel2010-06-071-1/+1
| | | | unnecessary tasks to be scheduled as we keep track of how many items will be produced for the task at hand. This introduces additional locking, but performns well in multithreaded mode. Performance of the master queue is still a huge issue, its currently the limiting factor, as bypassing the master queue in serial moode gives 15x performance, wich is what I would need
* improved testing to test the actual async handling of the pool. there are ↵Sebastian Thiel2010-06-071-2/+4
| | | | still inconsistencies that need to be fixed, but it already improved, especially the 4-thread performance which now is as fast as the dual-threaded performance
* Moved pool utilities into util module, fixed critical issue that caused ↵Sebastian Thiel2010-06-071-0/+106
| | | | havok - lets call this a safe-state
* First step of testing the pool - tasks have been separated into a new module ↵Sebastian Thiel2010-06-061-0/+24
including own tests, their design improved to prepare them for some specifics that would be needed for multiprocessing support