summaryrefslogtreecommitdiff
path: root/lib/git/async/task.py
Commit message (Collapse)AuthorAgeFilesLines
* Channel: Read method revised - now it really really doesn't block anymore, ↵Sebastian Thiel2010-06-091-1/+1
| | | | and it runs faster as well, about 2/3 of the performance we have when being in serial mode
* HSCondition: Fixed terrible bug which it inherited from its default python ↵Sebastian Thiel2010-06-091-1/+1
| | | | | | Condition implementation, related to the notify method not being treadsafe. Although I was aware of it, I missed the first check which tests for the size - the result could be incorrect if the whole method wasn't locked. Testing runs stable now, allowing to move on \!
* thread: fixed initialization problem if an empty iterable was handed inSebastian Thiel2010-06-091-1/+22
| | | | | queue: Queue now derives from deque directly, which safes one dict lookup as the queue does not need to be accessed through self anymore pool test improved to better verify threads are started correctly
* queue: fixed critical bug in the notify method, as it was not at all ↵Sebastian Thiel2010-06-091-2/+1
| | | | | | thread-safe, causing locks to be released multiple times. Now it runs very fast, and very stable apparently. Now its about putting previous features back in, and studying their results, before more complex task graphs can be examined
* workerthread: adjusted to use a blocking queue, it will receive termination ↵Sebastian Thiel2010-06-081-1/+1
| | | | events only with its queue, with boosts performance into brigt green levels
* Revised task deletion works well, adjusted test to be creating new tasks all ↵Sebastian Thiel2010-06-081-53/+11
| | | | the time instead of reusing its own one, it was somewhat hard to manage its state over time and could cause bugs. It works okay, but it occasionally hangs, it appears to be an empty queue, have to gradually put certain things back in, although in the current mode of operation, it should never have empty queues from the pool to the user
* task: now deletes itself once its done - for the test this doesn't change a ↵Sebastian Thiel2010-06-081-6/+16
| | | | thing as the task deletes itself too late - its time for a paradigm change, the task should be deleted with its RPoolChannel or explicitly by the user. The test needs to adapt, and shouldn't assume anything unless the RPoolChannel is gone
* Its getting better already - intermediate commit before further chaning the ↵Sebastian Thiel2010-06-081-0/+2
| | | | task class
* The new channeldesign actually works, but it also shows that its located at ↵Sebastian Thiel2010-06-081-3/+3
| | | | the wrong spot. The channel is nothing more than an adapter allowing to read multiple items from a thread-safe queue, the queue itself though must be 'closable' for writing, or needs something like a writable flag.
* introduced a new counter keeping track of the scheduled tasks - this prevent ↵Sebastian Thiel2010-06-071-2/+45
| | | | unnecessary tasks to be scheduled as we keep track of how many items will be produced for the task at hand. This introduces additional locking, but performns well in multithreaded mode. Performance of the master queue is still a huge issue, its currently the limiting factor, as bypassing the master queue in serial moode gives 15x performance, wich is what I would need
* improved testing to test the actual async handling of the pool. there are ↵Sebastian Thiel2010-06-071-0/+11
| | | | still inconsistencies that need to be fixed, but it already improved, especially the 4-thread performance which now is as fast as the dual-threaded performance
* task: Fixed incorrect handling of channel closure. Performance is alright ↵Sebastian Thiel2010-06-071-3/+21
| | | | for up to 2 threads, but 4 are killing the queue
* Moved pool utilities into util module, fixed critical issue that caused ↵Sebastian Thiel2010-06-071-1/+25
| | | | havok - lets call this a safe-state
* pool: First version which works as expected in async mode. Its just using a ↵Sebastian Thiel2010-06-071-2/+10
| | | | single task for now, but next up are dependent tasks
* Plenty of fixes in the chunking routine, made possible by a serialized ↵Sebastian Thiel2010-06-061-1/+1
| | | | chunking test. Next up, actual async processing
* First step of testing the pool - tasks have been separated into a new module ↵Sebastian Thiel2010-06-061-0/+144
including own tests, their design improved to prepare them for some specifics that would be needed for multiprocessing support