top | item 46944582

(no title)

ploum | 21 days ago

offpunk’s slowness has two main sources (while offline):

- loading modules at startup (will be solved in 3.1 with lazy loading, patch is pending)

- parsing HTML with lot of pictures (because we wait for chafa for each picture)

I’m not sure how multiprocessing could really help that much but I would be interested.

While online, sure, the blocking http calls are something that will be parallelized in the future

discuss

order

anthk|21 days ago

syncing URL lists should be done in parallel. Something like xargs+flock but under Python.

ploum|20 days ago

Contributions are welcome. I even believe that this whole code should be migrated from python-requests to curl.