Performance and efficiency gains at heart of world’s fastest analytical database for time series, IOT/sensor data
KX, a global leader in high performance analytical databases and vector-based data management, has announced substantial improvements to kdb+, the foundation of the company’s ability to bring time-oriented data insights and generative AI capabilities to the world’s leading enterprises.
Recognized as the fastest in-memory, columnar analytics database, kdb+ has served as the core engine of all KX products since its inception, delivering unmatched value to customers who operate in the toughest data management environments–financial markets. The latest version of kdb+ stays true to its roots by enabling users to ingest and analyze data faster, take advantage of AI capabilities, and securely scale to allow for management of more data than ever before.
“For three decades, kdb+ has been at the core of our innovation, empowering the transformation of data into actionable insights. This new version of kdb+ reaffirms our commitment to delivering simplicity, performance, and efficiency across the KX product suite, driving forward the AI-first ambitions of global organizations. It also celebrates our dedication to the vibrant kdb+ user community, whose loyalty and passion have been instrumental in shaping the evolution of our products,” said Ashok Reddy, CEO at KX.
The latest enhancements to kdb+ are designed to efficiently manage and analyze the vast datasets needed for generative AI with unparalleled efficiency and scalability. As the powerhouse behind the kdb Insights suite and KDB.AI, kdb+ provides organizations with the agility to navigate rapidly fluctuating market dynamics through expedited decision-making processes. These processes are fueled by advanced predictive analytics models that integrate both structured and unstructured data sources. Customers will realize significantly faster data ingestion rates, enhanced query execution speeds, and a marked decrease in storage expenditure.
“I’m particularly excited for our customers to experience new features, such as work-stealing, unified thread-scheduler, and the increased capacity for network connections,” said Charles Skelton, KX Chief Scientist. “At a developer level, I’m certain our community will enjoy the new language features around pattern matching that we previewed at our user conference in 2023.”
Notable improvements to kdb+ include:
Multi-threaded CSV Parser: Halves time-series data ingestion times, enabling faster analysis and quicker updates to AI models, both of which are crucial for real-time decision-making.
Peach with Work-Stealing Algorithm: Increases query execution speed by 30%, enhancing the performance of complex query executions and AI model computations.
Unlimited Network Connections: Allows for scalability to one million+ connections, delivering robust performance in high-volume time series data environments and AI applications.
HTTP Persistent Connections: Reduces connection overhead significantly, facilitating real-time data processing and enhancing the efficiency of data exchanges.
Enhanced TLS and OpenSSL: Provides secure, encrypted data transmission to ensure trust and compliance deemed crucial for regulated industries.
Additional algorithms for at-rest compression: Reduces storage costs while maintaining accessibility and optimizing data storage for AI operations, without compromising data access speed.
“This version of kdb+ turbocharges our commitment to differentiation in the name of customer value and reaffirms our position at the forefront of the industry. We look forward to continuing to push boundaries and set new standards in high-performance analytics databases for time series and IoT/Sensor data management,” said Reddy.
Kdb+ optimizes storage, ensures secure data transmission, streamlines data transfer processes, increases data connection scalability, enhances query execution performance and accelerates time series data ingestion. The time series database utilizes the powerful Q programming language, as well as Python and SQL, and is known for its high-performance, in-database analytic capabilities, holding 15 of 17 world records in STAC benchmarks. Kdb+ is the engine that powers critical missions for enterprises across the world and, time and again, has set the standard for transformational AI solutions.
To learn more about kdb+ 4.1 and to get started today, please visit: https://kx.com/products/kdb/
