
Patent Number 10,003,634
United States Patent 10,003,634 further improves the art of multi-threaded loading of a relational database from a source application by storing the record identifiers that meet a specified query range or filter, multi-threading readers on the content, saving the records in memory, and writing the records from memory into a database. The scalability and performance of this technique allows massive amounts of data to be loaded quickly and with full restartability in the event of a failure.
A system and method are presented for the facilitation of threaded download of software record identifiers and software records. Software record identifiers and software records are stored in separate one-dimensional stacks, which stacks feed a plurality of download threads in a first-in, first-out method. Software records and/or software record identifiers may optionally be written in parallel, or in an asynchronous manner. The total number of threads allowed to a user may optionally be limited to a pre-set number. The speed and efficiency of downloading records is increased through use of all of the cores of multi-cored computing systems to substantively concurrently download several threads. The method further allows a failed download thread to restart from the point at which it failed, rather than beginning again from the origin of the thread, thus ensuring that no software records are duplicated, and that no software records are skipped within a download thread.
Multi-Threaded Download with Asynchronous Writing
Awarded June 19, 2018
