What is DiPhyx?
DiPhyx is an AI-enhanced, container-based platform that seamlessly enables data processing and computing across the cloud, local machines, and HPC environments. DiPhyx has three main components: Orchestrator, dxflow, and Dashboard.
What is Orchestrator?
It is an intermediary service that is used, both directly and indirectly, to connect customers with cloud service providers such as Amazon Web Services, Google Cloud, and Microsoft Azure. The main objective of the Orchestrator is to manage resources across all services offered by DiPhyx.
What is dxflow?
It is a distributed-computing technology developed by the DiPhyx team. It manages the deployed container using a core engine and multiple custom plugins. The distributed nature of the technology enables it to be deployed on the cloud or local devices (computers, HPC, etc). dxflow is accessible via an API and can be set up using a proxy.
What is Dashboard?
It is a web-based graphical interface enabling users, teams, and companies to collaborate and access the services provided by Orchestrator and dxflow.
Why use DiPhyx?
Scenario: Let's assume you have a computational pipeline (data, models, software) that you want to set up and execute on the cloud, and archive the data and results in a cloud storage space for future use.
Without using DiPhyx ðŸ˜
- Create a user account with a cloud service provider (AWS, GCP, Azure).
- Set up a server and perform initial configurations.
- Install software prerequisites.
- Transfer initial data and run the computational program.
- Transfer the processed data to the storage space.
Disadvantages
- 🔴 Requires expertise in using the cloud service provider's platform.
- 🔴 Requires expertise in setting up cloud servers.
- 🔴 Requires sufficient time to set up the software prerequisites.
- 🔴 Complexity in monitoring computations and troubleshooting.
- 🔴 Complexity in transferring initial data and storing the processed data.
Using DiPhyx 😃
- Access the DiPhyx dashboard.
- Select the computational software or pipeline.
- Choose the server type from a cloud service provider.
- Transfer the initial data and run the computational program.
- Review the processed data and transfer it to the storage space.
Advantages
- 🟢 Uniform and easy access to cloud service providers.
- 🟢 No need for expertise in setting up and using cloud servers.
- 🟢 Efficient time management and resource utilization.
- 🟢 Ease of monitoring computations and troubleshooting.
- 🟢 Simplicity in transferring initial data and storing the processed data.
DiPhyx levels
Basic Level 🥉
- No subscription fee required.
- Abstracts you from the financial and technical processes on the cloud service
- Charges based on hourly usage of computational resources.
- Using many available software and models.
- Access to AWS, GCP, and Azure cloud storages.
Professional Level 🥈
- Subscription fee + charges for hourly usage of resources.
- Abstracts you from the financial and technical processes on the cloud service provider side.
- Publish your desired software package for your team.
- Provides dedicated storage space.
Enterprise Level 🥇
- Monthly subscription fee.
- DiPhyx will be deployed on your cloud service provider account.
- Compliant with highly regulated industries.
- Full access to your own servers and storage space.
- Directly pay the cloud service provider for the usage of resources.
What is under the hood of dxflow?
It is a set of separate services that run on the Docker platform. These services are divided into two main parts: the core and the extensions.
1. Redis Service
Core, Mandatory
A Redis database that stores and retrieves all the data required by the other services.
2. Core Service
Core, Mandatory
It is accessible through an HTTP web service interface. It processes requests and executes commands within the container environment. This service manages all administrative operations on the containers in the dxflow platform.
3. Syslog Service
Core, Mandatory
A log storage service that acts according to the Syslog protocol and stores the logs of the containers running on the dxflow platform in the Redis database.
4. Proxy Service
Extension, Optional
A proxy that processes all incoming requests in a secure environment and routes them to the appropriate service. This service also provides interactive sessions of the containers.
5. Storage Service
Extension, Optional
Accessible through an HTTP web service interface, it provides secure and easy access to files stored on the host disk. This service follows the TUS standard for file uploads with resume capability.
6. Sync Service
Extension, Optional
Accessible through an HTTP web service interface, it synchronizes the data bi-directionally between the host disk and the cloud storage. This service uses a queue for precise file synchronization.
7. Alarm Service
Extension, Optional
Accessible through an HTTP web service interface, its responsibility is to process alarm configuration requests and then continuously monitor and notify when the alarm is triggered.
Is it possible to set up dxflow on a local host?
Yes, you can set up dxflow on any host computer, whether it is a cloud-based or local system. Additionally, you have the option to ignore any optional extensions and use only the core dxflow components if you do not require those extra features.
Can I use DiPhyx as a software developer?
Yes, the processes of software development and debugging are readily available in DiPhyx. By using pre-defined software packages, you can increase the speed of development, and after performing the necessary debugging, you can proceed to transfer the programs to your production servers.