⚙️
Integrated Digital Engineering on AWS
  • 🚀First Time Users
    • What is IDEA?
    • Install IDEA
      • Pre-Requisites
      • Standard Installation
    • Access your IDEA cluster
      • APIs
      • Virtual Desktops (Linux/Windows)
      • Web Interface
      • SSH
    • File Browser
    • Let's get started
    • Cluster operations
      • Uninstall IDEA
      • Update IDEA cluster
        • Patch IDEA module (idea-admin.sh patch)
        • Update IDEA configuration (idea-admin.sh config)
        • Update IDEA backend resource (idea-admin.sh deploy)
  • 🤖Modules
    • What is a module?
    • Virtual Desktop Interfaces
    • HPC Workloads
    • Cluster Manager
    • Shared Storage
  • 👑Best Practices
    • Analytics
      • OpenSearch
        • Configure your OpenSearch
        • Create your own analytics visualizations
    • Budget
      • Review your AWS spend
      • Control your AWS spend
      • Set up budget per project
    • Security
      • Backup IDEA environment
  • 🧱Architecture
    • High Level Overview
  • 🛠️Developer Portal
    • IDEA CLI utility
    • Developer Onboarding
  • 🚨Help and Support
    • FAQ
    • Raise a bug
Powered by GitBook
On this page
  1. Best Practices
  2. Analytics
  3. OpenSearch

Create your own analytics visualizations

PreviousConfigure your OpenSearchNextBudget

Last updated 2 years ago

Make sure to have reviewed Configure your OpenSearch

Click the hamburger menu to reveal the left sidebar then click "Visualize" under "OpenSearch Dashboards" section.

Below are some example to help you get started:

(Scale-Out-Workloads) Money spent by instance type
  • Select "Vertical Bars"

  • Select the "scheduler_jobs" index

  • Y Axis (Metrics):

    • Aggregation: Sum

    • Field: estimated_bom_cost.line_items_total.amount

    • Custom Label: Cost

  • X Axis (Buckets):

    • Aggregation: Terms

    • Field: params.instance_types_raw

    • Order By: metric: Cost

    • Size (adjust as needed): 20

    • Custom Label: Instance Type

  • Split Series (Buckets):

    • Sub Aggregation: Terms

    • Field: params.instance_types_raw

    • Order By: metric: Sum of Cost

    • Size (adjust as needed): 20

Example (click to enlarge):

(Scale-Out-Workloads) Jobs per user
  • Select "Vertical Bars"

  • Select "scheduler_jobs*" index

  • Y Axis (Metrics)

    • Aggregation: count

  • X Axis (Buckets):

    • Aggregation: Terms

    • Field: owner.raw

    • Size (adjust as needed): 20

  • Split Series (Buckets):

    • Sub Aggregation: Terms

    • Field: owner.raw

    • Order By: metric: count

    • Size (adjust as needed): 20

Example (click to enlarge):

(Scale-Out-Workloads) Jobs per user grouped by instance type
  • Select "Vertical Bars"

  • Select "scheduler_jobs" index

  • Y Axis (Metrics):

    • Aggregation: count

  • X Axis (Buckets):

    • Aggregation: Terms

    • Field: owner.raw

    • Order By: metric: Count

    • Size (adjust as needed): 20

  • Split Series (Buckets)

    • Sub Aggregation: Terms

    • Field: params.instance_types.raw

    • Order By: metric: Count

    • Size (adjust as needed): 20

Example (click to enlarge):

(Scale-Out-Workloads) Instance type launched by user
  • Select "Heat Map"

  • Select "scheduler_jobs" index

  • Value (Metrics):

    • Aggregation: Count

  • Y Axis (Buckets):

    • Aggregation: Term

    • Field: params.instance_types.raw

    • Order By: metric: count

    • Size (adjust as needed): 20

  • X Axis (Buckets)

    • Sub Aggregation: Terms

    • Field: owner.raw

    • Order By: metric: count

    • Size (adjust as needed: 20

Example (click to enlarge):

(Scale-Out Workloads) Number of nodes in the cluster
  • Select "Lines"

  • Select "scheduler_nodes*" index

  • Y Axis (Metrics):

    • Aggregation: Unique Count

    • Field: instance_id

  • X Axis (Bucket)

    • Aggregation: Date Histogram

    • Field: provisioning_time

    • Interval: Minute

Example (click to enlarge):

(Scale-Out-Workloads) Detailed Information per user
  • Select "Datatables"

  • Select "scheduler_jobs" as index

  • Metric (Metrics):

    • Aggregation: Count

  • Split Rows (Buckets):

    • Aggregation: Term

    • Field: owner.raw

    • Order By: metric: Count

    • Size (adjust as needed): 20

  • Split Rows (Buckets):

    • Aggregation: Term

    • Field: params.instance_type.raw

    • Order By: metric: Count

    • Size (adjust as needed): 20

  • Split Rows (Buckets):

    • Aggregation: Term

    • Field: estimated_bom_cost.total.amount

    • Order By: metric: Count

    • Size (adjust as needed): 20

Example (click to enlarge):

(VDI) Most active VDI users
  • Select "Pie"

  • Select "vdc_users_sessions*" index

  • Metrics:

    • Slice Size: Count

  • Split Slices (Buckets):

    • Aggregation: Terms

    • Field: owner.raw

    • Order By: metric: count

    • Size (adjust as needed): 20

Example (click to enlarge):

👑