Databricks and Posit announce new integrations, simplifying Lakehouse entry for builders

In the present day, Databricks and Posit are thrilled to announce a strategic partnership to offer R and Python builders with an simplified growth expertise when working with Databricks. To satisfy this objective, we’re collaborating with product and engineering groups at Posit to ship an enhanced integration between Posit Workbench and Databricks, help for Spark Join in R, and the internet hosting of Posit Workbench on the Databricks Apps Market. Let’s take a more in-depth look:

Enhanced entry to your Databricks Workspace from Posit Workbench

Posit Workbench is the usual for enterprise deployments of RStudio IDE, the fan-favorite growth expertise for R builders in all places. The brand new Databricks integration with Posit Workbench will simplify connecting to Databricks Workspaces, accessing information, working code, and interacting with different sources like Databricks Workflows or MLflow fashions. We’re very excited to have the ability to deliver Databricks to wherever you might have Posit Workbench put in!

Help for Spark Join in R by way of sparklyr

Since Apache Spark 3.4, Spark Join was launched to decouple the client-server structure, permitting IDEs and trendy information purposes to entry Spark interactively with minimal setup. Now, Posit is including help for Spark Join in R by way of sparklyr, making it simpler for customers to entry Spark clusters – together with Databricks clusters by way of Databricks Join. For a lot of R builders, sparklyr is the popular methodology to work with Apache Spark as a consequence of its unification with dplyr and the tidyverse ecosystem in addition to its integration with the Connections pane in RStudio IDE. sparklyr will proceed this custom and enhance parity with Python by means of wrapping the PySpark API, giving R builders extra decisions in the case of writing Spark purposes.

Posit Workbench in Databricks Market

Mutual prospects usually ask us if Posit merchandise might be hosted inside their Databricks Workspace. In the present day, that is restricted to RStudio Server or Posit Workbench put in immediately on Databricks compute sources within the information airplane. Bringing Posit Workbench to Databricks Market permits for a a lot deeper integration. Market choices can run immediately on a buyer’s Databricks occasion, combine with their information, and allow customers to work together by means of single sign-on: combining the best requirements of safety, privateness, compliance, and scalability with information by no means having to depart the shopper’s account. Clients can take pleasure in their favourite developer tooling proper on the shores of their Databricks Lakehouse.

As Databricks and Posit additional strengthen their partnership, the information neighborhood stands to reap the advantages of those thrilling new developments. The sparklyr package deal, improved integration of Posit Workbench with Databricks, and the addition of Posit Workbench within the Databricks Apps Market demonstrates our dedication to offering complete options for our shared prospects. We look ahead to witnessing the transformative impression of those developments on our prospects’ data-driven journeys.

Please join right here to get notified of product updates.