Confluent research shows data streaming platforms are key for AI product innovation

Data streaming pioneer Confluent have released findings from its fourth annual Data Streaming Report, which surveyed 4,175 IT leaders across 12 countries, including 225 from Australia.

The results make it clear that data streaming platforms (DSPs) are no longer optional; they are critical to Artificial Intelligence (AI) success and broader business transformation. A majority of Australian IT leaders (85%) believe data streaming platforms will increasingly be used to feed AI systems with real-time, up to date, contextual and trustworthy data — key requirements for real-time AI applications.

The study also found that nearly all (97%) of IT leaders’ organisations globally have experienced at least one challenge, such as insufficient infrastructure for real-time data processing, when it comes to accelerating AI and machine learning (ML) adoption. This highlights the need for platforms that can manage real-time data at scale.

“The latest findings from Confluent’s research in Australia and globally shows us that data streaming shouldn’t be viewed as just an data infrastructure upgrade, it should be seen as a business accelerator — a driver for real-time innovation,” said Simon Laskaj, Regional Director ANZ at Confluent. “From powering insights in real-time to enabling the latest advancements in AI, data streaming platforms are the driving force behind meeting today’s business needs.”

Maximising Data Investments

According to the research, data streaming technology pays dividends, with a substantial majority (73%) of Australian organisations surveyed experiencing a 2-5x return on their data streaming investments. Another 12% reported a 10x return on investments. Meanwhile, data streaming platforms mitigate issues such as data silos (89%) and accessing data that exists (81%) for the bulk of businesses.

It should come as no surprise, then, that 93% of Australian IT leaders are planning to increase their investment in data streaming platforms in 2025 compared to previous years, more than the global average of 90%. These figures demonstrate the increasingly important role data streaming platforms play in organisations in Australia today.

“The benefits achieved by businesses that prioritise data streaming platforms are widespread. Nearly every IT leader surveyed sees multiple benefits,” said Laskaj. “Data streaming platforms are uniquely able to address key data challenges, helping to deliver continuous, trustworthy and contextual data so organisations can deploy AI applications at scale.”

Other key Australian findings include:

• 97% of respondents reported at least one significant challenge when it comes to their use of data and related technologies, such as data availability, inconsistent data sources, timeliness and quality issues, or governance-related disjoints. 80% of respondents in Australia agreed that AI systems must leverage enterprise data to realise its true potential.
• 89% of respondents believe data streaming platforms will ease the path to enterprise-level AI adoption.
• 84% of Australia’s IT leaders have adopted a ‘shift left’ approach to reduce costs and risks across development and operations. This paradigm sees them performing data processing and governance closer to the source of data generation and earlier in the data pipeline, significantly improving data reliability and operational efficiency.