Welcome to cloud_pipe’s documentation!

cloud_pipe is an automatic setup tool for setting up the data analysis pipeline on the Amazon Web Services (AWS). It provides an easy to deploy, use and scale your data analysis algorithm and work flow on the cloud as well as sharing between colleges and institutions. It is developed in Python 3 using boto, the AWS SDK for Python.

Now cloud_pipe is on Pypi, and it supports pip. The latest version is v0.0.3.dev. To install cloud_pipe, pip install cloud_pipe. After install cloud_pipe:

To submit an algorithm or bring your analyze tool, use wrap -ds. For more options, check: wrap –help

To run single algorithm or deploy you analytical work flow, use setup-pipe -f your-workflow-json. For more options, check: setup-pipe –help

General

• General

Quick Start

• For Algorithm Developers
  • Using command line editor
  • Use pre-prepared json file
• For Algorithm User
  • Prerequisition on AWS
  • Prepare your work flow json file
  • Run your work flow

How it works

• How it works
  • Overview
  • Wrap
  • Run

Demos

API References

• API Reference
  • Api for Algorithm Developers
  • Api for Algorithm Users

Roadmap

• Road Maps
  • Recent work
  • Future work

Indices and tables

• Index
• Module Index
• Search Page