{"id":8536,"date":"2018-01-10T00:00:14","date_gmt":"2018-01-10T00:00:14","guid":{"rendered":"http:\/\/craftydba.com\/?p=8536"},"modified":"2024-12-26T21:06:06","modified_gmt":"2024-12-26T21:06:06","slug":"provi","status":"publish","type":"post","link":"https:\/\/craftydba.com\/?p=8536","title":{"rendered":"PROVIDENCE USER GROUP – January 2018"},"content":{"rendered":"

I am enthusiastic about presenting to the Providence SQL Server User Group<\/a> on January 10, 2018. <\/p>\n

Of course, I am looking forward to talking to my friends Matt Batalon and Gregory Celentano. If you have not figured it out yet, I love to chat to local user groups about any SQL server topic that I am passionate about.<\/p>\n

The meeting venue is at the following address. <\/p>\n

New England Institute of Technology
\n 1408 Division Rd
\n East Greenwich, RI<\/p>\n

Details about the presentation are below.<\/p>\n

Topic:<\/span><\/p>\n

Staging data for Azure SQL services<\/p>\n

Abstract:<\/span><\/p>\n

Most companies are faced with the ever-growing big data problem.\u00a0 It is estimated that there will be 40 zettabytes of new data generated between 2012 to 2020.\u00a0 See the computer world\u00a0article<\/a>\u00a0for details.\u00a0<\/p>\n

\nMost of this data will be generated by sensors and machines.\u00a0\u00a0 However, only a small portion of the data is available for users.\u00a0 How can IT professionals help business lines gather and process data from various sources?\n<\/p>\n

\nThere have been two schools of thought<\/span> on how to solve this problem.\n<\/p>\n

\nSchema on write<\/span> is represented by the traditional relational database. Raw data is ingested by an extract, transform and load (ETL) process. The data is stored in tables that enforce integrity and allow for quick retrieval. Only a small portion<\/span> of the total data owned by the company resides in the database.\n<\/p>\n

\nSchema on read<\/span> is represented by technologies such as Hadoop or PolyBase. These technologies assumed that data integrity was applied during the generation of the text files. The actual definition of the table is applied during the read operation. All data<\/span> owned by the company can reside in simple storage.\n<\/p>\n

\nToday, we will learn how to stage data using Azure blob storage<\/span>. This staged data can be ingested by both techniques.\n<\/p>\n

Coverage:<\/span><\/p>\n

\n1 – Grab some big data.
\n2 – Create blob storage account.
\n3 – Copy data to container.
\n4 – Azure SQL database plumbing.
\n5 – Loading data with BULK INSERT.
\n6 – Azure SQL data warehouse plumbing.
\n7 – Loading data with POLYBASE.
\n8 – Azure automation with RUNBOOKS.<\/p>\n

Details:<\/p>\n

presentation bundle<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

I am enthusiastic about presenting to the Providence SQL Server User Group on January 10, 2018. Of course, I am looking forward to talking to my friends Matt Batalon and Gregory Celentano. If you have not figured it out yet, I love to chat to local user groups about any SQL server topic that I am passionate about. The meeting venue is at the following address. New England Institute of Technology 1408 Division Rd East Greenwich, RI Details about the presentation are below. Topic: Staging data for Azure SQL services…<\/p>\n","protected":false},"author":1,"featured_media":7269,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[600],"tags":[1122],"class_list":["post-8536","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-pres","tag-john-f-miner-iii--pass--presentation--providence--ri--sql-user-group--azure-blob-storage--azure-sql-db--azure-sql-dw-"],"_links":{"self":[{"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/posts\/8536","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8536"}],"version-history":[{"count":1,"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/posts\/8536\/revisions"}],"predecessor-version":[{"id":10340,"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/posts\/8536\/revisions\/10340"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/media\/7269"}],"wp:attachment":[{"href":"https:\/\/craftydba.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8536"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8536"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8536"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}