Skip to main content

Getting Started with DataSQRL

DataSQRL makes it easy to implement data products as data pipelines or event-driven microservices. You'll be building powerful data products with DataSQRL in no time. How you get started is up to you. We recommend the "Learning by Doing" route, but you can choose your own adventure.

Learning By Doing

If you're looking to learn DataSQRL, the best way is to build something with it:

Nut Shop Tutorial >|

STEP 1: Read the Quickstart to build a metrics monitoring data product in 10 minutes.

STEP 2: Dive into the DataSQRL tutorial to get a deeper understanding of DataSQRL and learn everything you need to build your own data product with DataSQRL.

STEP 3: Build your own data product with DataSQRL. Take a problem from work or grab some data you've been interested in and give it a go.

Need more information? Take a look at the reference documentation for everything you'd ever wanted to know about DataSQRL and then some.
Still stuck? No worries, the DataSQRL community is here to help. Seriously, reach out - we don't bite!

Understanding the Big Picture

There are a million technologies out there so why should you spend your time on DataSQRL? If you want to understand how DataSQRL fits into the bigger picture and whether it's worth your time, here are some resources to get you started.

DataSQRL allows you to build with data >

DataSQRL is a compiler, optimizer, and build tool for data pipelines and event-driven microservices. To implement a data product in DataSQRL, you implement the data processing in SQL and (optionally) define the API of your data product in GraphQL schema. DataSQRL compiles those two artifacts into an optimized data pipeline that ingests, processes, stores, queries, and serves data through a responsive API in realtime.

DataSQRL solves the data plumbing issue that plagues most data product implementations. It eliminates integration code, schema mappings, physical data modeling, data flow orchestration, and other low-level implementation details that take a lot of time and effort. DataSQRL enables you to implement the entire data pipeline in one piece of code and compiles all the executables you need to deploy the pipeline. In other words, DataSQRL saves you a ton of time, money, and headache.

DataSQRL supports various pipeline topologies and has a pluggable engine architecture that allows DataSQRL to compile to proven technologies like Apache Kafka, Apache Flink, and Postgres. That means you are not relying on DataSQRL in production but can use the technologies and cloud services you already trust. DataSQRL compiles data pipelines that are resilient, fast, and scalable by using an optimizer that determines the most efficient data pipeline for a configured architecture.

What to know more? Start with the reference documentation to learn everything there is to know about DataSQRL.
What to go even deeper? The developer documentation details the internals of DataSQRL and takes you deep into the guts of the system.