Saturday, June 26, 2021

Export the whole Excel with all the columns and rows through Power BI service

  • Connect your database to Power BI through Power BI Desktop
  • Create the tables depending on your requirements
  • Publish to Power BI service 
  • Export the whole excel: not analyze in excel



  • Instead, click ... on the right-hand side
  • Export data

Thursday, June 17, 2021

Random thoughts about my career path

I recently received so many emails and messages, which makes me start to consider the difference between IT data analysts and business analysts.

After Google these two job descriptions, I don't consider myself a business analyst. Instead, I'm an IT data analyst on the path to become a data scientist.

First, my daily routine at work contains lots of programming processes. When I was pursuing my Master's degree in Information Technology, my school mainly focused on Java. But after I came to the San Franciso Bay area, I realized that Python is one of the most popular languages in Silicon Valley. So I started to learn Python by myself. Every day, after work from Tesla (2018-2019), I would go back home to practice programming in Python for around 2 hours per day. Right now, at my current job, data cleansing is a big part of my daily routine. So I use Python(Pycharm/Jupyter) to create codes concentrating specifically on the data cleaning requirements from my current company. Whenever I receive the files which need to be cleaned, I need to run those codes and adjust different lines based on the new requirements.

Second, I started building the data warehouse using Google Cloud Storage(GCS) and Google Cloud Platform(GCP). The majority of my colleges are extremely professional in the Oracle database. So it becomes my main focus to build the data warehouse. GCS and GCP are brand new to me too. So I keep learning all the new processes, just like when I was learning how to program in Python. After several months, the data warehouse has been built, of course with my colleges' support too, and the data will keep growing.

Third, I started to get professional training in Power BI in March this year. Whenever people talk about Power BI, you will think about all the beautiful charts to improve, execute, and effectively communicate significant analyses that identify meaningful trends and opportunities across the business. I agree this is part of my Power BI training and future tasks. But what I'm focusing on is how to automatically transfer the database to Power BI using parameters or even more complex functions through Power BI. This is different from what I can only create those beautiful charts.

Now, I understand clearly my career path is to become a professional data scientist. 






Sunday, June 13, 2021

Dynamic Filter Using Parameters in PowerBI

A parameter serves as a way to easily store and manage a value that can be reused.

Parameters give you the flexibility to dynamically change the output of your queries depending on their value.


#1 click "Transform data" on the Home Tab











↓ 












#2 Create a unique list of RegionName as an option to choose from when the report runs. For this, right-click the RegionName column header and select "Add a New Query"
















↓ 




















#3 Now we still don't have a unique list of values on our list query, so right-click the column header again to remove duplicates












↓ 



















#4 Now we have a unique list of RegionName, let's store this list in a form of a parameter. Click the Home tab, click "Manage Parameters"














↓ 

Click New















Note: "current value" is a default value.

Click OK












#5 The next thing we need to do is to apply a parameterized filter on the overview table so that the data loads only for the selected RegionName. To do this, click on the arrow icon on the RegionName column header, go to the "Text Filters",  and select "Equals"













↓ 

change the filter type to "parameter"















And select the parameter we just created

Click Ok, Click "Close&Apply"















Now we can only see the default value of RegionName we set up, which is the "Greater Manchester"


#6 The last thing we need to do is make this filter selection pop out to the users when they run this report. To do this, go to the File menu, click Save as, save the report with a name and change the type to Power Bi template files.
















Now we run this file, you will see the system is coming out with this list of RegionName to choose from, which is a part of the parameter we created.












Then choose the RegionName data you would like to see, now the reports show the analysis only for the selected RegionName.

Thursday, June 3, 2021

How to connect Oracle Database to Power BI

#1:

Make sure you have installed:

https://www.oracle.com/technetwork/database/windows/downloads/index-090165.html


#2:
Make sure your TNS Name file (tnsnames.ora) is correct
Test with Toad or other SQL Utility that uses the TNS NAME file
not SQL Developer (that does not use the tnsnames.ora file to Connect)
C:\app\client\your_windows_user_name\product\12.1.0\client_1\Network\Admin


#3:
In the Power BI Get Data Oracle database

In the box Server:
(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=service_name)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=your_service_name)))













Oracle database server format: Host:Port/SID









#4:
Use the database credentials to access your data


Helpful source: 

https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-connect-oracle-database