Expansion of System Memory using Intel Memory Drive Technology
Intel Memory Drive Technology (IMDT) is a software-defined memory (SDM) product that allows for the expansion of system memory beyond DRAM by defining some of the PCIe-based Intel Optane SSD capacity as memory, instead of as storage. It executes directly on the hardware and below the operating system, and allows for system memory to be assembled from DRAM and the PCIe-based Intel Optane SSD. It leverages economic benefit of SSDs, and operates transparently as volatile system memory.
It is optimized for up to 8x system memory expansion over installed DRAM capacity and provides ultra-low latencies and close-to DRAM performance for SDM operations. It is designed for high-concurrency and in-memory analytics workloads.
At runtime, the DRAM is used as cache. When there is a cache-miss, IMDT intercepts and brings the data into DRAM. It does so by using machine learning to continuously prefetch data from the Optane SSDs.
Currently responsible for producing technical collateral such as white papers, reference architecture documents and technical briefs that cover performance and benchmarks of Intel® Optane™ SSD's in Big Data solutions that use technologies such as Spark and Hadoop.
Total experience of 20 years in the roles of Big Data & DataWarehouse Architect / Sr. Developer in technologies including Hadoop, Spark, Greenplum, Oracle, Informatica. Highly proficient in building Data Ingest pipelines for MPP platforms like Hadoop and Greenplum.
