{"id":18072,"date":"2022-03-02T14:12:16","date_gmt":"2022-03-02T14:12:16","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2022\/03\/02\/dremio-unveils-forever-free-tools-for-data-lake-analytics\/"},"modified":"2022-03-02T14:12:16","modified_gmt":"2022-03-02T14:12:16","slug":"dremio-unveils-forever-free-tools-for-data-lake-analytics","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2022\/03\/02\/dremio-unveils-forever-free-tools-for-data-lake-analytics\/","title":{"rendered":"Dremio unveils ‘forever free’ tools for data lake analytics"},"content":{"rendered":"

<\/a>\n
<\/p>\n

\n

Dremio Corp<\/a>.<\/u>, developer of an SQL query engine that works on the semistructured data repositories called data lakes, is kicking off its Subsurface<\/a> conference today with what it says is the most significant set of new and updated products in its history \u2013 and all are perpetually free.<\/p>\n

They include the general availability of its cloud service and two new services: Dremio Sonar, a lakehouse engine built for SQL, and Dremio Arctic, a metadata and data management service for the Apache Iceberg high-performance format for large analytic tables.<\/p>\n

The company said Dremio Cloud is the first lakehouse platform to be built from scratch for SQL workloads. \u201cIn the past, companies had to weigh the pros and cons of data lakes versus data warehouses,\u201d Chief Executive Billy Bosworth said in a prepared statement. \u201cWe\u2019ve eliminated this tradeoff by providing a frictionless and infinitely scalable service that delivers the combined benefits of both.\u201d<\/p>\n

\u2018Easy to get started\u2019<\/h3>\n

Dremio Cloud is being made available as a perpetually free service on the assumption that \u201ccompanies will become familiar with Dremio, run their analytics on our platform and some percentage of them will later realize it\u2019s valuable and want enterprise security and support, service-level agreements and integration with their cloud identity management system,\u201d said co-founder and Chief Product Officer Tomer Shiran (pictured). \u201cWe\u2019re focusing on making it easy for people to get started.\u201d<\/p>\n

Dremio Sonar is a free service built for SQL that delivers all the performance and features of a data warehouse on Amazon S3 object storage. Based on the Apache Arrow columnar in-memory analytics engine, Dremio Sonar is 68% faster than its predecessor and supports inserts, updates, deletes and transactions, or \u201call the operations you can do in a data warehouse query,\u201d Shiran said. This enables users to run business intelligence workloads directly on the lakehouse.<\/p>\n

Dremio enables subsecond query response times by automatically and transparently rewriting query plans to utilize different aggregations or layouts of tables and views, the company said. Its built-in semantic layer allows data operators to provide a consistent and secure view of data to consumers along with self-service curation of new data sets.<\/p>\n

Dremio SQL Runner and SQL Profiler are new visual tools within Sonar that enable SQL-proficient users to run and troubleshoot queries and scripts directly from the Dremio interface. A set of database connectors allows for joins across multiple data sources, including relational stores. Connections are built in to popular client tools, including Microsoft Corp.\u2019s Power BI, Tableau Software Inc.\u2019s Tableau, the dbt data transformation tool, Hex Technologies Inc.\u2019s collaborative data workspace and Preset Inc.\u2019s data exploration and visualization platform.<\/p>\n

Like Git for data<\/h3>\n

Dremio Arctic is another free service based on the open-source Apache Iceberg<\/a>\u00a0analytics table format and Nessie<\/a>\u00a0data catalog that delivers a Git-like experience for the data lakehouse. Git is an open-source distributed version control system favored for its snapshotting capabilities.<\/p>\n

The Dremio Arctic metastore simplifies data engineering and analysis by making the experience of working with data workflows similar to working with source code. That includes branching for data ingest, transformation and experimentation in isolation, the ability to reproduce historic dashboards or machine learning models without maintaining data copies and a GitHub-like interface.<\/p>\n

The cloud service persists data in Apache Iceberg tables backed by Apache Parquet files on Amazon Web Services Inc. S3 storage. Users are free to use any query engine they want, even if it doesn\u2019t come from Dremio, Shiran said.<\/p>\n

\u201cThe Git experience hasn\u2019t existed for data,\u201d he said. \u201cThis fits with how engineers work with data. They want to work in isolation and then join it and to have tables that span multiple users.\u201d<\/p>\n

Dremio Sonar and Dremio Cloud are now generally available. Dremio Arctic is in public preview.<\/p>\n

Photo: SiliconANGLE<\/h5>\n
\n
\n

Show your support for our mission by joining our Cube Club and Cube Event Community of experts. Join the community that includes Amazon Web Services and Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger and many more luminaries and experts.<\/span><\/h3>\n<\/div><\/div>\n