Spice.xyz May Update | Enterprise-Grade Performance for Web3 Data

Margaret Zhang
The Spice AI Blog
Published in
6 min readJun 23, 2023

--

🔵 Updates and improvements to Spice.xyz — May 2023

A few weeks ago, Spice AI completed its upgrade to second generation platform architecture (Gen. 2). Today, we walk through the key performance upgrades that empower developers building the next generation of apps with the fastest, easiest, and smartest way to leverage web3 data.

Spice.xyz now features improved developer experience in app with expandable query SQL explorer, SQL query error underline, and collapsible side bar.

Feature of the Month: Performance Upgrade 🚀

Until now, most data platforms remain dashboard-focused and don’t prioritize infrastructure performance. Spice.xyz is application-focused and built specifically to address the development infrastructure gap from day one.

Developers like EigenLayer trust the enterprise-grade infrastructure to be

Reliable. >99.9% high-availability.
Scalable. 1000+ SQL queries per second.
Fast. Subsecond block indexing.

Let’s get started 🟢🟢🟢 ↓

🟢 Block Latency

Spice.xyz returns the most recent block accurately and in seconds.

It takes just <1 second for core data and 2.5 seconds* for enriched data to query availability from time we see the block — down from an already low-latency 3.6 seconds. The next closest solution has a block time latency of 10 seconds, while the industry standard takes more than 30 minutes!

For application developers that require real-time data, such as building transaction auditing and personalized UX, subsecond block latency is a game changer.

Comparing Block Latency Performance

*block time: average latency from when Spice sees the block in our nodes to when it is available to be queried in platform, for Ethereum, at 95% confidence level.

This also enables sophisticated DeFi models and apps to retrieve a month’s (720h) worth of ETH-BTC prices in just 1.04 seconds using the historical prices API at a 5 minute granularity:

Gen. 1 vs Gen. 2 block latency performance: Retrieving a month’s (720h) worth of ETH-BTC prices using our historical prices API at a 5 minute granularity

🟢 Execution Speed

Querying execution time is up to 15x faster! With Spice AI’s multi-chain architecture, queries span cross-chain and cross-dataset for ecosystem-wide insights.

Spice.xyz Gen. 1 vs Gen. 2 querying execution speed improvement

You can test examples in the SQL Explorer by referencing pre-written sample queries from the Spice.xyz docs:

  1. Get All NFTs from a single collection — instant, complete BAYC insights
  2. Get Cross DEX prices — complex, multi-source queries with ease
  3. Get Most Ethereum burned — fast gets 10x faster
  4. Get Ethereum address of ENS domain — match your data, know your users
  5. Get Sushiswap Liquidity — better pulse check, better moves
  6. Get Advanced Liquidity Aggregations for USD Token Pairs — pricing accuracy referencing min, max, average
  7. Get Confidence for Token Standards — simple smart contract checks
  8. Get Voluntary Exits Count — harness the new Beacon dataset
  9. Get Last 5000 blocks — experience the power of Spice’s Apache Arrow API
  10. Get Average Gas Used by Transactions per Block — get smart and optimize your gas fees

Accelerate accessing web3 data further by querying with SQL over high-performance Apache Arrow APIs.

🟢 Planet-Scale for any Enterprise

Gen. 2 handles an even larger volume of queries. Enjoy updated plan limits that can run up to 1000 requests per second and 50 concurrent requests. These scalability improvements enable developers to retrieve data from the blockchain more efficiently and perform previously impossible analyses with complex queries.

🟢 Enabling Intelligent Applications

The rollout of Spice AI’s second generation platform architecture (Gen. 2) helps bring enterprise-scale data infrastructure to further advance the capabilities of AI/ML across chains:

  • more scalable platform that handles data more effectively means Spice can support more chains, faster.
  • for the first time, enhanced speed and efficiency allows developers to leverage fast AI-ready, web3 data for inferencing.

App-builders can now ship better experiences and use cases — critical to the success of intelligent applications in web3.

For more information, visit our docs.

What’s New

1. Expandable Query SQL Explorer and Collapsible Side Bar

Make the query zone larger for a complete view of complex SQL queries both in standard view and full screen mode. Simply drag the bottom of the explorer to adjust the split between your query and results.

Expandable SQL Explorer and Full Screen Mode. Featured Query: Advanced Liquidity Aggregations for USD Token Pairs

Expand the explorer while maintaining access to the Python, Node.js, and Go SDKs. Simply toggle views with the translucent collapse side bar tab located on the bottom left corner of the app.

Get started now →

2. SQL Query Error Underline

Writing SQL just got simplier. The spice.xyz query editor underlines errors in your SQL query and suggests fixes directly in app. Compose precise, clear, mistake-free queries to get the results you need faster. You can also query in plaintext and let Spice AI Flow autocomplete with a SQL query.

Developers will receive a red error notice in Results and a red underline indicating the error location in the query.

Query error underlined in red

Hover over the underlined text to view error notice, problem, and potential quick fixes.

View problem

Get started now →

⬇️ Login to Spice.xyz to get started:

🔵 Around the corner

Two highly requested datasets, Ethereum Wallet Balances and NFT Metadata, will be released out of preview.

🌐 Community updates

The 2023 Season 2 Flow Hackathon is LIVE. Spice AI and Niftory hosted the Flow Hackathon Seattle Kick Off to accelerate participating project and connect with fellow builders in person.

👥 Join the new and growing Spice Community:

Twitter | LinkedIn | GitHub | Discord | Telegram

💡 We’re hiring! 💡

We’re looking for innovators across engineering and design. You can discover the latest opportunities at Spice AI here, and learn how you can play a leading role in shaping the future of intelligent app development.

The Team at Spice AI.

About Spice AI

Spice AI is the fastest, easiest and smartest way to build data and AI-driven apps in web3. Designed for applications and machine learning, we remove the complexity of building and operating massive data infrastructure — enabling teams to create the next generation of data and AI-driven apps.

We are the first service to deliver developer-friendly bulk data over high-performance Apache Arrow APIs. We’ll soon be the first to deliver AI/ML capabilities for blockchains.

If you’re developing on Polygon, Ethereum, or Bitcoin, you can build effortlessly with Spice’s enterprise scale data and AI infrastructure in just three lines of code.

Get started now →

Have questions or feedback? Contact us

Spice.ai | View previous releases

--

--

Head of Partnerships @Spice AI | Ex VC Fellow @INVC (M12, Notion) | PM @Gartner | Investment Summer Associate @Temasek | Amateur Mountaineer | NYU Stern Alum