FAQ

Last Updated

October 2022

If you wish to provide feedback on this lab, there is an error, or you want to make a suggestion, please email: cloud-intelligence-dashboards@amazon.com

General

Which dashboards are available for installation?

We have several dashboards- CUDOS, KPI, CID, Compute Optimizer, Trusted Advisor (TAO) and Trends, Full documentation can be found here

How can I install Cloud Intelligent Dashboards?

First you need to run pre-requisite steps, after that you can follow the instructions here for the specific required dashboard

What columns are in the Cost and Usage Report (CUR), what do they mean?

CUR documentation can be found here

Where can I find more info about CUR delivery timelines and any FAQs for CUR?

On average, CURs are updated up to 3 times daily, but that will fluctuate depending on the size of the file/amount of user usage and many other factors. you can monitor your CUR S3 bucket to see the date/time the new month’s file is deposited. Within the CUR itself you can see the corresponding usage dates/times to infer which usage is reflected within that file.

Do the Cloud Intelligent Dashboards support gzip compression formats or CSV CUR files?

The CUR must be in Parquet (Athena) format.

Do the Cloud Intelligent Dashboards support CUR without resource ids?

The CUR must be have resource ids.

In which regions can Cloud Intelligent Dashboards be deployed?

CID requires QuickSight, Athena and Glue , All regions that support QuickSight, Athena and S3. Cost Usage Reports (CUR) Bucket would also have to be in the same region as those services. CUR bucket can be replicated to the region that supports CIDs via S3 bucket replication. When using the cid-cmd, you can define the Region to deploy the dashboard in as a parameter eg. cid-cmd –region_name eu-west-2 deploy This is especially helpful when using Cloudshell and the region you want to deploy in, does not support Cloudshell.

How long does it take to initially deploy the Cloud Intelligent Dashboards Framework?

Assuming pre-requisites were met correctly the automation would take around 5-10 minutes to deploy, manual lab execution can take up to 60 minutes.

Do I need to learn any coding skills to customize the analysis?

No, just AWS native BI service QuickSight and customer facing data Cost and Usage Reports structure. Here is public documentation for QuickSight and Cost Usage Reports .

How do I edit or customize the dashboards?

In order to create an analysis from any of the CUDOS Dashboards, Go edit the newly created dashboard’s permissions to enable the “Save As” option:

Go to your Templated Dashboard.
Click “Share”
Click “Share dashboard”
Enable the "Allow "save as"" next to your username
Click "Confirm"
Click the link in the top left corner to Go back to 'LazyMBR'
You should now see a “Save as” (you might have to refresh browser)
Click "Save as"
Name your Analysis
Once completed, you can then customize the Analysis filters, visuals etc.

You can see an example on this video (1:23)

How do I setup the dashboards in an account other than my payer account or on top of multiple payer accounts?

This scenario allows customers with multiple payer (management) accounts to deploy all the CUR dashboards on top of the aggregated data from multiple payers. To setup the dashboards on top of multi payer accounts, please review multi-account setup deployment options and instructions.

What are the solution limitations?

Amazon QuickSight supports up to 30 visuals in a single sheet, and a limit of 20 sheets per analysis. QuickSight SPICE capacity for Enterprise edition is up to 500 million rows or 500 GB per dataset. Amazon Athena DML query timeout is max 4 hours.

How can I share dashboards with other users?

You can share dashboards and visuals with specific users or groups in your account or with everyone in your Amazon QuickSight account. Or you share them with anyone on the internet. You can share dashboards and visuals by using the QuickSight console or the QuickSight API. Access to a shared visual depends on the sharing settings that are configured for the dashboard that the visual belongs to. To share and embed visuals to your website or application, adjust the sharing settings of the dashboard that it belongs to. For more information, see the following:

How Unit Cost is being calculated?

In general- spend in $/usage_quantity For example for Compute/RDS we take only instances running hours cost and divide by usage, for S3 we take only storage cost and divide by storage size

Can we see MarketPlace usage on Cloud Intelligent Dashboards?

Yes, on CUDOS dashboard under MoM Trends tab. You have 2 filters Billing Entity and Legal entity

How can I export a dashboard to PDF?

On the right upper corner of the dashboard, click on the Export icon → Generate PDF

How can I export a visual to CSV?

Click on a specific visual, click on the 3 dots → Export to CSV

How can I change KPI values on KPI dashboard?

On KPI dashboard, under Set KPI Goals tab. Choose a specific KPI and adjust the bar according to your KPI value

Troubleshooting

Cost values or other numbers in the Cloud Intelligence Dashboards don’t match what I see in my invoices or in Cost Explorer - what do I do?

Click here to expand answer

I am getting the error “Casting from TimestampTZ to Timestamp is not supported” - what do I do?

Click here to expand answer

When running the summary_view.sql query from Athena, I get the error “Column ‘product_database_engine’ cannot be resolved”. How do I resolve it?

If you get this error it is very likely that none of your accounts have launched an RDS instance. To make this column show up in the CUR, launch a database in the RDS service, let it run for a couple of minutes and then shut it down. In the next iteration of the crawler, the column will appear. Running the query again should now result in success.

How do I fix the ‘product_cache_engine’ cannot be resolved error?

This view is dependent on having or historically having an RDS database instance and an ElastiCache cache instance run in your organization. If you get the error that the column product_database_engine or product_deployment_option does not exist, then you do not have any RDS database instances running. There are two options to resolve this.

I’m getting an error in QuickSight that is saying Athena timed out?

For very large CUR files, Athena may time out trying to query the data for summary_view. In Athena, find the summary_view view, click the three dots next to it and select show/edit query. Modify the following:

  • Request Athena DML query timeout increase via support case.
  • Or, adjust the granularity to monthly, by changing ‘day’ to ‘month’ in row 6.
  • Or, adjust the look back from ‘7’ months to desired time-frame in row 75.
  • In QuickSight, refresh your dataset.

Account list is missing/incorrect, how can I update them?

You can update the account list with the following query: CREATE OR REPLACE VIEW account_map AS

SELECT account_id, concat (account_name,': ‘, account_id) account_name from acc_metadata_details

How do I fix the COLUMN_GEOGRAPHIC_ROLE_MISMATCH error?

When attempting to deploy the dashboard manually, some users get an error that states COLUMN_GEOGRAPHIC_ROLE_MISMATCH.

Click here to expand answer

I’ve deployed the Compute Optimizer Dashboard. If a new linked account is created after deployment, can the dashboard collect the data from the newly created linked account automatically?

Click here to expand answer

I am getting the following error from my tables associated with the optimization data collection lab; “HIVE_PARTITION_SCHEMA_MISMATCH: There is a mismatch between the table and partition schemas. The types are incompatible and cannot be coerced”.

Click here to expand answer

Pricing

How much does it cost to run the CID Framework?

Cost breakdown using Calculator -

  • S3 cost for CUR: < $5-10/mon
  • QuickSight Enterprise: < $30/mon/author or $5max/mon/reader
  • QuickSight SPICE capacity: < $10-20/mon
  • Total: $100-$200 (for Number of working days per month (22), SPICE capacity in gigabytes (GB) (100), Number of authors (3), Number of readers (15),

Customization

How can I add tagging visuals to CUDOS dashboard?

Step by step can be found on this video

How to get alerts from dashboards?

Step by step can be found on this video

Security

How do I limit access to the data in the Dashboards using row level security?

Do you want to give access to the dashboards to someone within your organization, but you only want them to see data from accounts or business units associated with their role or position? You can use row level security in QuickSight to accomplish limiting access to data by user. In these steps below, we will define specific Linked Account IDs against individual users. Once the Row-Level Security is enabled, users will continue to load the same Dashboards and Analyses, but will have custom views that restrict the data to only the Linked Account IDs defined.

Step by step instructions can be on this video

We have an encrypted S3 buckets for CUR and Athena query results. Does CID Framework support encrypted S3 buckets?

Yes. QuickSight would require an IAM role and a suitable IAM policy allowing access to KMS.

Can I encrypt my CUR buckets in S3?

Click here to expand answer

Can I do cross-account queries in Athena instead of replicating CUR buckets?

CUR bucket replication is the preferred method because it is tested and documented. Technically you can use cross-account methods but it is untested. It is true that CUR bucket replication will create more cost as the you will have to store the CUR twice, although you could think of it as a backup in case something happens to the payer accounts. We recommend CUR bucket replication also because the Athena tables are created/updated via a Glue crawler where you get all CUR schema changes handled. Glue crawlers don’t support cross account set up. It also gets significantly more complicated if KMS encryption is used.

This page will be updated regularly with new answers. If you have a FAQ you’d like answered here, please reach out to us here cloud-intelligence-dashboards@amazon.com.