Create Cost Intelligence Dashboard

Authors

• Alee Whitman, Commercial Architect (AWS OPTICS)

Contributors

• Arun Santhosh, Specialist SA (Amazon QuickSight)
• Kareem Syed-Mohammed, Senior Product Manager - Technical (Amazon QuickSight)
• Aaron Edell, Global Head of Business and GTM - EC2 Insights
• Timur Tulyaganov, AWS Technical Account Manager
• Yuriy Prykhodko, AWS Technical Account Manager

FAQ

The FAQ with the added Visual by Visual breakdown for this dashboard is here.

Request Template Access

Ensure you have requested access to the Cost Intelligence template here.

Optional: Advanced Setup using a CloudFormation Template

This section is optional and automates the creation of the Cost Intelligence Dashboard using a CloudFormation template. The CloudFormation template allows you to complete the lab in less than half the time as the standard setup. You will require permissions to modify CloudFormation templates, create an IAM role, create an S3 Bucket, and create an Athena Database. If you do not have the required permissions skip over this section to continue using the standard setup.

To create the dashboard using the standard setup move to the Create Athena Views section

Create Athena Views

The data source for the dashboard will be an Athena view of your existing Cost and Usage Report (CUR). The default dashboard assumes you have both Savings Plans and Reserved Instances, if not you will need to create the alternate views.

1. Login via SSO in your Cost Optimization account, go into the Athena console:

2. Modify and run the following queries to confirm if you have Savings Plans, and Reserved Instances in your usage. If no lines are returned, you have no Savings Plans or Reserved Instances. Replace (database).(tablename) and run the following:

   Savings Plans:

    select * from (database).(tablename)
    where savings_plan_savings_plan_a_r_n not like ''
    limit 10
   

   Reserved Instances:

    select * from (database).(tablename)
    where reservation_reservation_a_r_n not like ''
    limit 10
   

3. Create the Summary view by modifying the following code, and executing it in Athena:

   • View1 - Summary

4. Create the EC2_Running_Cost view by modifying the following code, and executing it in Athena:

   • View2 - EC2_Running_Cost

5. Create the Compute savings plan eligible spend view by modifying the following code, and executing it in Athena:

   • View3 - compute savings plan eligible spend

6. Create the s3 view by modifying the following code, and executing it in Athena:

   • View4 - s3

7. Create the RI SP Mapping view by modifying the following code, and executing it in Athena:

   • View5 - RI SP Mapping

Create QuickSight Data Sets

We will now create the data sets in QuickSight from the Athena views.

1. Go to the QuickSight service homepage

2. Click Manage data:

3. Click New dataset

4. Click Athena

5. Enter a data source name of Cost_Dashboard and click Create data source:

6. Select the costmaster database, and the summary_view table, click Edit/Preview data:

7. Select SPICE to change your Query mode:

8. Select Save:

9. Select the summary_view Data Set:

10. Click Schedule refresh:

11. Click Create:

12. Enter a schedule, it needs to be refreshed daily, and click Create:

13. Click Cancel to exit:

14. Click the x in the top corner:

15. Repeat steps 3-14, creating data sets with the remaining Athena views. The data source name will be Cost_Dashboard, and select the following views as the table:

• s3_view
• ec2_running_cost
• compute_savings_plan_eligible_spend

16. Select summary_view Data Set:

17. Select Edit data set

18. Select Add Data:

19. Select your ri_sp_mapping view and click Select:

20. Select the two circles to open the Join configuration then select Left to change your join type:

21. Select Add a new join clause two times so you have 3 join clauses:

22. Create following 3 join clauses then click Apply:

    • ri_sp_arn = ri_sp_arn_mapping
    • payer_account_id = payer_account_id_mapping
    • billing_period = billing_period_mapping

23. Select Save

Create the Dashboard

We will now use the CLI to create the dashboard from the Cost Intelligence Dashboard template, then create an Analysis you can customize and modify in the next step.

1. Go to this page to request access to the template. Enter your AWS AccountID and click Submit: Template Access

2. Edit the following command, replacing AccountID and region, then using the CLI list the QuickSight datasets and copy the Name and Arn for the 4 datasets: s3_view, ec2_running_cost, compute_savings_plan_eligible_spend, summary_view:

    aws quicksight list-data-sets --aws-account-id (AccountID) --region (region)
   

3. Get your users Arn by editing the following command, replacing AccountID and region, then using the CLI run the command:

    aws quicksight list-users --aws-account-id (AccountID) --namespace default --region (region)
   

4. Create a local file create-dashboard.json with the text below, replace the values (Account ID) on line 2, (User ARN) one line 7, and each Dataset (ARN) on lines 25, 30, 35, 40:

    {
        "AwsAccountId": "(Account ID)",
        "DashboardId": "cost_intelligence_dashboard",
        "Name": "Cost Intelligence Dashboard",
        "Permissions": [
            {
                "Principal": "(User ARN)",
                "Actions": [
                        "quicksight:DescribeDashboard",
                        "quicksight:ListDashboardVersions",
                        "quicksight:UpdateDashboardPermissions",
                        "quicksight:QueryDashboard",
                        "quicksight:UpdateDashboard",
                        "quicksight:DeleteDashboard",
                        "quicksight:DescribeDashboardPermissions",
                        "quicksight:UpdateDashboardPublishedVersion"
                ]
            }
        ],
        "SourceEntity": {
            "SourceTemplate": {
                "DataSetReferences": [
                    {
                        "DataSetPlaceholder": "summary_view",
                        "DataSetArn": "(Summary Dataset ARN)"
   
                    },
                                            {
                        "DataSetPlaceholder": "ec2_running_cost",
                        "DataSetArn": "(ec2_running_cost Dataset ARN)"
   
                    },
                                            {
                        "DataSetPlaceholder": "compute_savings_plan_eligible_spend",
                        "DataSetArn": "(compute_savings_plan_eligible_spend Dataset ARN)"
   
                    },
                                            {
                        "DataSetPlaceholder": "s3_view",
                        "DataSetArn": "(s3_view Dataset ARN)"
   
                    }
                ],
                        "Arn": "arn:aws:quicksight:us-east-1:869004330191:template/cost-intelligence-dashboard"
            }
        },
        "VersionDescription": "1"
    }
   

5. To create the dashboard from the template, edit then run the following command, replacing (region) and you should receive a 202 response:

    aws quicksight create-dashboard --cli-input-json file://create-dashboard.json --region (region)
   

6. After a few minutes the dashboard will become available in QuickSight under All dashboard, click on the Dashboard name:

7. Click here - if you do not see your dashboard

   Edit and run the following command:

       aws quicksight describe-dashboard --aws-account-id (YOUR ACCOUNT ID) --dashboard-id cost_intelligence_dashboard --region (region)
   

   Correct the listed errors and run the delete-dashboard command followed by the original create-dashboard command:

       aws quicksight delete-dashboard --aws-account-id (YOUR ACCOUNT ID) --dashboard-id cost_intelligence_dashboard --region (region)
   

8. Click Share, click Share dashboard:,

9. Click Manage dashboard access:

10. Add the required users, or share with all users, ensure you check Save as for each user, then click the x to close the window:

11. Click Save as:

12. Enter an Analysis name and click Create:

13. You will now have an analysis created from the template that you can edit and modify:

Additional Dashboard Resources

For opportunities to customize or add additional dashboard insights

• Continue with modules 2-4 in the Level 200: Enterprise Dashboard
• Create the CUDOS dashboard to get ideas on visuals you want to add to your Cost Intelligence Dashboard. The CUDOS QuickSight dashboard is built on top of the Cost Intelligence Dashboard so you can leverage your existing data sets.