Patent Number 10,003,634
Multi-Threaded Download with Asynchronous Writing
United States Patent 10,003,634 further improves the art of multi-threaded loading of a relational database from a source application by storing the record identifiers that meet a specified query range or filter, multi-threading readers on the content, saving the records in memory, and writing the records from memory into a database. The scalability and performance of this technique allows massive amounts of data to be loaded quickly and with full restartability in the event of a failure.
A system and method are presented for the facilitation of threaded download of software record identifiers and software records. Software record identifiers and software records are stored in separate one-dimensional stacks, which stacks feed a plurality of download threads in a first-in, first-out method. Software records and/or software record identifiers may optionally be written in parallel, or in an asynchronous manner. The total number of threads allowed to a user may optionally be limited to a pre-set number. The speed and efficiency of downloading records is increased through use of all of the cores of multi-cored computing systems to substantively concurrently download several threads. The method further allows a failed download thread to restart from the point at which it failed, rather than beginning again from the origin of the thread, thus ensuring that no software records are duplicated, and that no software records are skipped within a download thread.
United States Patent 10,003,634 covers a multi-threaded download with asynchronous writing system designed to improve the performance and reliability of loading large volumes of data. The patented method enables multiple download threads to retrieve records efficiently while asynchronous writing processes store data without blocking throughput. This architecture improves restartability, reduces transfer failures, and increases scalability when working with very large datasets. The invention is particularly valuable for enterprise ETL, analytics replication, and migration workflows where performance and fault tolerance are critical. By supporting parallel processing and efficient record management, this patent provides a foundation for high-speed data movement across cloud and on-prem systems.
This patent matters because large-scale enterprise data movement requires both speed and reliability. By combining multi-threaded download with asynchronous writing, the invention improves throughput, supports restartable transfers, and enables scalable replication for modern ETL, analytics, and migration pipelines.
Method for Multi-Threaded Async Download
Awarded June 19, 2018