Gearman to the Rescue!

March 1, 2020

This article offers a setup of Gearman for Parallel/Distributed processing.

Introduction

An elegant and generic application framework for parallel and distributed processing.

Setup

1. Setup gearadmin and gearman with.

2. Setup gearman job server for mac.

3. You can get the gearman python package.

4. Copy the gearman package as shown and install the requirements.

  $ source /path/to/env
  $ python -m site
  $ cp -r <path/to/gearman/package/dir> </path/to/env>/lib/python3.8/site-packages/
  $ pip install -r requirements.txt

5. To check the proper installation do

  $ gearadmin --server-version
  $ gearadmin --status

6. To check the proper installation of the python gearman package do

  $ python -c "import gearman"

if no error is thrown then you are good to go.

Gearman Architecture

A web cast to get a good idea about the architecture of the Gearman.