How to use Amorphic Utils?

info

• Follow the steps mentioned below.
• Total time taken for this task: 10 Minutes.
• Pre-requisites: User registration is completed, logged in to Amorphic and role switched

Tidbits

• Amorphicutils is a package developed to accelerate developer productivity on Amorphic. It has following features.
• Data Engineering
  • Reading csv, excel data in python
  • Reading csv , redshift in pyspark
  • Writing csv, bytes in python
  • Writing csv in pyspark
  • Check if the dataload is successful
  • Get last upload_date epoch folder
  • Get list of epoch folders
  • Get new epoch folders
  • Get new files greater than a upload_date epoch
• Bookmarking in Amorphic
• Amorphic API
• Amorphic CLI

Steps to be followed

• Step1: Click here for getting started with entrypoints of python and pyspark.

• Step2: Click here for reading data from Amorphic using python.

• Step3: Click here for reading data from Amorphic using pyspark.

• Step4: Click here for writing data to Amorphic using python.

• Step5: Click here for writing data to Amorphic using pyspark.

• Step6: Click here for datalake utils.

• Step7: Click here for bookmarking in Amorphic.

• Step8: Click here for Amorphic APIs.

• Step9: Click here for Amorphic CLI.

• Click here to learn about retrieving resource ID for any Amorphic resource.

tip

Amorphic APIs scope in Amorphicutils is limited. You can access all of the APIs using the regular python requests module.