luigi-workflows

Data workflows for the numer.ai machine learning competition

Building Classification & Prediction model to classify the Loan applicant request as approved or rejected and then predict the Interest rate for Loan Approval.

luigi based workflow for analysising WGS samples collecting from different source. It will auto clustering, annotating gene or species, and finally perform pangenome analysis(roary).

luigi workflows to evaluate models trained by vowpal wabbit

Allow Luigi tasks to fail softly, without cancelling downstream tasks.

Extension of luigi.Task more suitable for reproducable data analysis workflows

Pipeline for calling and analyzing variants from RNA-Seq data

CRISPR sgRNA design for the Genetic Perturbation Platform at the Broad Institute

🔍 Predict loan approval and calculate credit risk using a full-stack ML web app with Flask backend, React frontend, and Docker deployment.

Proyek ini adalah pembuatan pipeline ETL untuk mengelola data dari berbagai sumber, termasuk PostgreSQL, file CSV, dan web scraping dari Lazada serta Tokopedia. Data diekstraksi, dibersihkan, dan ditransformasikan sebelum dimuat ke dalam database PostgreSQL untuk analisis lebih lanjut, mendukung kebutuhan tim di Perusahaan XYZ.

demo / tutorial of python and luigi

Resources for AWS Almaty Meetup: Building scalable Data Lake with AWS

Easy and powerful template for ML projects

This is a learning repository about DVC Data Version Control and Luigi Pipelines

Sebagai seorang Data Engineer di Erdigma, tugas ini bertujuan untuk menggabungkan beberapa file CSV yang berasal dari Google Drive ke dalam satu file agar dapat diinput ke database. Pengolahan data ini dilakukan dengan menggunakan Python dan Luigi sebagai workflow automation.