One thing that jumped out at me was that you tend to dump items into your @context folder without adding to your NA list--without processing, in other words. I suspect you need a better in-box. You want a razor-sharp line drawn between things that have been collected but not processed and things that are safely in your system. That in box is a nice safe place to keep things until you're ready to process them.