Thursday, July 14, 2016

Azure SQL Data Warehouse

Microsoft introduced new cloud-based data warehousing service as Azure SQL Data Warehouse which is strongly capable to processing massive volumes of data, both relational and non-relational. 
Microsoft stated that it is built to support petabytes of data and can be scaled up and down in a matter of minutes or even seconds with compute and storage resources separated to better control operations, costs and in which analytics and data management played a central role. It is based on Massively Parallel Processing (MPP) architecture and capable to handle Enterprise workloads. Now, Azure SQL Data Warehouse is moving from Standard to Premium Storage, offering new performance benefits for the service.l

Cloud data warehousing and business intelligence with Azure SQL Data Warehouse is containing several new features such as-
  1. Azure Active Directory authentication:  Azure Active Directory is a comprehensive identity and access management cloud solution that provides a robust set of capabilities to manage users and groups. It helps secure access to on-premises and cloud applications, including Microsoft online services such as Office 365 and many non-Microsoft SaaS applications. This comes in three editions: Free, Basic and Premium.
  2. Large-row support: Azure SQL Data Warehouse is built to support for large rows which is larger than 32K and data types over 8K. Large row support enhances support for varchar(max), nvarchar(max) and varbinary(max).
  3. Transaction size limits: Transaction size limits have been implemented to allow users to execute large operations that may run for over an hour, but small enough to prevent a long running rollback that could run for many, many hours. This safety limit was put in place to prevent conditions which could turn into a long database outage, like if a user tries to pause during a long running transaction.
  4. Improved Visual Studio support: It supports automatic installation and updates of the latest SQL Server Data Tools (SSDT) version for SQL Data Warehouse support and improved integration means that automatic updates of SSDT will now occur whenever new versions are released which will be eliminating the need to manually search and install SSDT.
  5. T-SQL Support: Several T-SQL data types and commands previously only available in SQL Server are now available in SQL Data Warehouse. These features will add functionality and reduce some of the migration work between the two platforms.
  6. Archival compression for clustered columnstore tables:  This release introduces archival compression for Clustered Columnstore tables. This optional compression algorithm allows you to further compress data as a way to reduce the cost for storing your data. The tradeoff of the cost savings is increased CPU utilization when querying the data.
  7. Support for RAND(), CHECKSUM(), BINARY_CHECKSUM(), NEWID(), and IS_SRVROLEMEMBER() functions
  8. Support for the sys.database_service_objectives dynamic management view (DMV) for Azure SQL Data Warehouse databases
Additional Benefits - There are many key features along with Azure SQL Data Warehouse which are given below:
  • Reduce cost with pause and scale
  • Maintain statistics
  • Use Azure Data Factory, PolyBase, and BCP to load and export data quickly
  • Hash distributes large tables and optimizes clustered columnstore tables
  • Drain transactions before pausing or scaling and minimize transaction sizes
  • Use DMVs to monitor and optimise your queries
Real-time analytics across our data pipeline with built-in BI
We understand the importance of Data Analytics which drives businesses today for better performance. Transform our business with real-time analytics for all of our data, structured and unstructured, with existing tools we already know and love—including industry-leading Power BI with 5 million users worldwide and Microsoft Excel.
Microsoft also works with a set of popular BI partners to ensure the tools will work great with SQL Data Warehouse and provide a way to insight including, Looker Data Sciences, Tableau Software, and Qlik Technologies. Plus, seamless compatibility with SQL Server Integration Services, Azure Stream Analytics, Azure Machine Learning, Azure Data Factory, and Azure Storage ensures insights over all of your data as fast as it’s coming in.
Introducing Premium Storage

Azure SQL Data Warehouse service is moving from Standard to Premium Storage to drive greater performance predictability and consistency for query run-times, especially at higher data warehouse units (DWUs). Starting today, every new data warehouse that's created will use Azure Premium Storage in most regions where Premium Storage is available.
Conclusion
Azure SQL Data Warehouse service is moving from Standard to Premium Storage to drive greater performance predictability and consistency for query runtimes, especially at higher data warehouse units (DWUs). Starting today, every new data warehouse that's created will use Azure Premium Storage in most regions where Premium Storage is available.
References: Microsoft

4 comments:

  1. These work processes could incorporate modules for ingesting the information from an assortment of sources, producing highlights, trainings, scoring and assessing ML models. machine learning certification

    ReplyDelete
  2. You delivered such an impressive piece to read, giving every subject enlightenment for us to gain information. Thanks for sharing such information with us due to which my several concepts have been cleared. USA domestic freight brokerage service

    ReplyDelete
  3. Stockroom loaning is regularly portrayed as a generally safe, high return business, yet there is a lack of distribution center moneylenders. The huge public banks have either exited the market totally, or have confined their loaning to extremely huge clients and exceptionally conventional item. A significant number of the leftover second level banks center basically around early buy programs for their own item,warehouse shelving

    ReplyDelete
  4. I should say only that its awesome! The blog is informational and always produce amazing things. best doctor for lasik surgery in delhi

    ReplyDelete