Level Up Your Data Game with Exciting New Features in Hitachi Solutions’ Empower Platform
5 minute read
Unlock the Full Potential of Data with Enhanced Catalog, Sharing, AI, and Chat Capabilities in Latest Empower Release
Fresh off the announcements made at the Databricks’ Data and AI Summit this past week, Hitachi Solutions is excited to announce major updates to its Empower Data Platform, shipping now to all customers with Release 1.14. With this latest release, all Hitachi Solutions customers will have access to major new features rolling out now:
- Data Catalog – Empower is releasing a redesigned data pipeline with Unity Catalog which will allow customers to have end-to-end visibility into changes happening in their Lakehouse.
- Internal Data Sharing – Never copy data within your organization for other Lakehouse’s, Empower environments, or products. Now you simply grant permission and go. No cloning, no pipelines, no hassle.
- Delta Sharing with Partners – Want to share or consume data from a partner? Empower customers can now share or even buy and sell data between business partners: updates are instantly available from the source with no latency, meaning that you can share (or use shared data) the moment it lands in the source table.
- Enterprise Chat – With Empower Enterprise Chat, customers can chat with advanced tools like Open AI GPT4, and even connect those LLMs to their data estate securely and privately.
- Generative AI for Developers – Empower will now support the entire LLM lifecycle with new Lakehouse AI capabilities from Databricks: train, deploy, and expose data via API’s without touching a deployment or a server, using new machine learning functionality by Databricks.
Let’s take a closer look at these powerful new Empower features.
Data Catalog
Unity Catalog is a FREE unified security and governance feature set built by Databricks. It provides several critical features that make Empower a more robust data estate solution. First, Unity Catalog tracks how data is transformed at the lowest level, allowing users to answer the question: “how was this calculated?” with ease. Combining this with the ability to create business (and technical) definitions for your data estate is a powerful capability which makes your data more usable for self-service. Advanced features like row filters and column masks enable fine-grained control on what content users and groups can see, keeping your data secure without hassle.
Internal Data Sharing
With the new Unity Catalog feature set, Empower’s existing capabilities have been extended to manage more than one data estate or Lakehouse inside your business. This means divisions in your business can have separate estates that seamlessly integrate data with no performance impact or copying of data – plus you can centrally manage, govern, audit and track usage of all shared data with Empower. How do you do it? Just SQL.
Simply select from the other environment. Yes, it’s that simple.
Secure Data Sharing with Partners
Your business relies on your own data just as much as it relies on your partners’ data. Now Empower allows organizations to share data with partners and associates outside of your tenant leveraging Delta Sharing. Partners need not be Empower customers, or even use the Databricks Lakehouse platform.
Even better, customers aren’t just limited to sharing your data. You can share access to your trained, proprietary AI models, without sharing your source code or requiring access to your customer’s data. Delta Sharing enables you to run your AI models on your client’s compute infrastructure in a secure containerized way. You define who can use your model and Empower will take care of the rest.
Enterprise Chat
Empower now supports the ability for you to chat against your enterprise data. With the rise of Large Language Models (LLMs) such as ChatGPT, organizations have been clamoring for a way to utilize these models to communicate with their own data.
Today we are launching Empower Enterprise Chat which allows customer to leverage the power of GPT4 and other LLMs to improve employee productivity and to share prompts across the business. This tool is the first step in preventing critical enterprise data from leaking to third-party datasets, with extensible support for chatting with your own data. Enterprise Chat does not share data with other companies: your data and prompts remain your own.
To get customers started with chatting with their own data we are launching support for Databricks Vector Search, a new capability built on top of Unity Catalog, that allows hassle-free context injection into your LLMs to get more focused query results. Of course, users will only have access to relevant data as defined in your Unity Catalog.
Generative AI for Developers
Empower Data Platform now offers Generative AI capabilities specifically designed for developers. With the integration of new AutoML support for LLMs, developers can manage the entire Large Language Model (LLM) lifecycle, which includes tasks such as training the AI model, deploying it, and providing access to the data through APIs (Application Programming Interfaces). Moreover, all these tasks can be accomplished without the need for manual intervention in server deployment or management, making the process more efficient and streamlined for developers.
These are just a few of the exciting features Empower is beginning to rollout in version 1.14! For more information, or to get started with Empower, reach out to our team at [email protected].
