{"id":7138,"date":"2014-03-05T00:00:03","date_gmt":"2014-03-05T00:00:03","guid":{"rendered":"http:\/\/craftydba.com\/?p=7138"},"modified":"2016-04-19T20:29:49","modified_gmt":"2016-04-19T20:29:49","slug":"power-query-part-3","status":"publish","type":"post","link":"https:\/\/craftydba.com\/?p=7138","title":{"rendered":"Power Query – Part 3"},"content":{"rendered":"

There has been a big push for self service business intelligence tools by Microsoft in recent months. The center of this universe is Microsoft Excel. <\/p>\n

I will keep on going with talks about Power Query which is a self service ETL add-in for MS Excel. This tool was released <\/a>in August of 2013. In addition to my blog, the online help<\/a> is a good place to start learning about this tool.<\/p>\n

Last time, I demonstrated how the “get external data” and “excel data” ribbon buttons can be used to export the source data into the Query editor. Also, we saw how Power Query is very flexible given the large number of import options. <\/p>\n

Today, I am going to start flushing out the various operations in the Query Editor that can be used to refine our data.<\/p>\n

We first need to open the “Postal Codes” workbook query by selecting the edit option. The following ribbon will show on top of the data.<\/p>\n

\"C01-power-query-toolbar-ribbon\"<\/a><\/p>\n

I am going to concentrate on the “reduce” operations. These operations reduce the number of columns or rows in the resulting data set.<\/p>\n

The “remove top rows” operation can be used to delete rows from the top of the data set.<\/p>\n

\"C02-power-query-remove-top-n-rows\"<\/a><\/p>\n

The “remove columns” operation has two choices. Either we can remove a highlighted column or we can remove all columns except for highlighted one.<\/p>\n

\"C03-power-query-remove-columns\"<\/a><\/p>\n

The next operation is kind-of interesting since I can not image a real life usage case. The “remove alternating rows” operation starts at row A and removes B rows and keeps C rows in a alternating pattern.<\/p>\n

\"C04-power-query-reduce~remove-alternate-rows-1\"<\/a><\/p>\n

If we apply these choices to the postal codes data set, the following information is left over.<\/p>\n

\"C05-power-query-reduce~remove-alternate-rows-output-2\"<\/a><\/p>\n

I am avoiding the “remove errors” operation since the easiest way to create an error is to change the target data type. Most data coming into Power Query defaults as a text data type. We will cover this operation when I show you how to change data types in the “transform” section of the ribbon.<\/p>\n

Also, I am purposely skipping the “remove duplicates” operation. I will demonstrate this operation when I cover the “combine” section of the ribbon. I will be able to double the data after we cover the “append” operation under that section.<\/p>\n

The “keep top rows” operation allows the user to remove rows at the end of the data set. Only the top most N rows will be keep.<\/p>\n

\"C08-power-query-reduce~keep-top-rows\"<\/a><\/p>\n

To round off row operators, the “keep range” button allows you to slice out a range of rows. <\/p>\n

\"C09-power-query-reduce~keep-range\"<\/a><\/p>\n

Just like the RIGHT, LEFT and MID string functions, I consider the REMOVE TOP, KEEP TOP, and KEEP RANGE operators as similar purposed functions that operate on rows of data.<\/p>\n

In a nutshell, the Power Query tool supplies the user with tools to reduce the number of rows and\/or columns in the source data set. Thus, cleaning up the raw data before being analyzed in the Power Pivot, Power View or Power Map tools.<\/p>\n","protected":false},"excerpt":{"rendered":"

There has been a big push for self service business intelligence tools by Microsoft in recent months. The center of this universe is Microsoft Excel. I will keep on going with talks about Power Query which is a self service ETL add-in for MS Excel. This tool was released in August of 2013. In addition to my blog, the online help is a good place to start learning about this tool. Last time, I demonstrated how the “get external data” and “excel data” ribbon buttons can be used to export…<\/p>\n","protected":false},"author":1,"featured_media":7070,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1042],"tags":[15,1062,1061,1043,1055,1057,1060,1059,1058,1045],"class_list":["post-7138","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-power-query","tag-john-f-miner-iii","tag-keep-range","tag-keep-top-rows","tag-power-query","tag-query-editor","tag-reduce-operations","tag-remove-alternating-rows","tag-remove-columns","tag-remove-top-rows","tag-self-service-etl"],"_links":{"self":[{"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/posts\/7138","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=7138"}],"version-history":[{"count":0,"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/posts\/7138\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=\/wp\/v2\/media\/7070"}],"wp:attachment":[{"href":"https:\/\/craftydba.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=7138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=7138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/craftydba.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=7138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}