How to Access Up-to-Date Cloud Compute Resource Data Using SpareCores sc-data

Accessing real-time data on cloud compute resources can be challenging. SpareCores offers a solution with their sc-data tool, providing structured, standardized data on cloud resources that's constantly updated. This article explains how to install, use, and benefit from this valuable resource.

What is SpareCores sc-data?

SpareCores sc-data is a Python package designed to standardize and provide real-time data regarding cloud compute resources. It leverages the sparecores-crawler to gather data and offers an easy-to-use interface for accessing it. The crawler updates spot prices every 5 minutes and all cloud resources hourly, ensuring you have the latest information.

Key Features and Benefits

• Real-time Data: Access constantly updated information on cloud resources.
• Standardized Data: Data is standardized for easy analysis and comparison of different cloud providers.
• Easy Installation: Simple installation via pip.
• SQLite Database: Data is stored in an SQLite database for easy querying.

Installation Steps

You can install sparecores-data using pip. Choose the installation method that best suits your needs:

• Stable Version (from PyPI):

  pip install sparecores-data
  

  Copy
• Most Recent Version (from GitHub):

  pip install "sparecores-data @ git+https://[email protected]/SpareCores/sc-data.git"
  

  Copy

Basic Usage

Accessing the SQLite database file is straightforward. Here's how:

1. Import the db object:

   from sc_data import db
   

   Copy
2. Access the database path:

   print(db.path)
   

   Copy
   This will output the path to the SQLite database file. The database updates every 600 seconds by default.

Customizing the Update Interval

You can customize the database update interval using either a built-in attribute or an environment variable:

• Using the built-in attribute:

  sc_data.db.refresh_seconds = 300  # Update every 300 seconds
  

  Copy
• Using the environment variable: Set the SC_DATA_DB_REFRESH_SECONDS environment variable to your desired interval in seconds.

Benefits of Using SpareCores sc-data

• Cost Optimization: Monitor spot prices to optimize cloud resource costs.
• Resource Management: Keep track of available cloud resources.
• Automation: Automate tasks based on real-time cloud resource data.

Additional Resources

• sparecores-crawler documentation
• Database schemas
• Latest SQLite database release
• sparecores.com

License

SpareCores/sc-data is licensed under the CC-BY-SA-4.0 license, ensuring broad usage and collaboration.

By leveraging SpareCores sc-data, you gain access to a reliable, up-to-date source of cloud compute resource data, enabling better decision-making and optimization of your cloud infrastructure.