My name is Thanyasit

Expert in Web-Scraping 

About

I’m a software engineer specializing in web-scraping, using reverse engineering methodology to transform complex web pages into structured data with Python and Scrapy. With experience in developing over 2000 bots, I have contributed to 6 large-scale projects. Beyond web scraping, I develop Kubernetes-ready backend applications with Go, building efficient REST APIs and gRPC services for both stateless and stateful systems. I’m passionate about solving problems and delivering scalable, clean, and effective solutions. Let’s bring your ideas to life!

Skills

Python iconPython
Scrapy iconScrapy
Playwright iconPlaywright
Go iconGo
Gin iconGin
gRPC icongRPC
NATs iconNATs
Postgres iconPostgres
Supabase iconSupabase
Typescript iconTypescript
React iconReact
Docker iconDocker
Kubernetes iconKubernetes
Helm iconHelm
Github Actions iconGithub Actions
ArgoCD iconArgoCD
Terraform iconTerraform
Google Cloud iconGoogle Cloud
GKE iconGKE
AWS iconAWS
Lambda iconLambda

Projects

Distributed Notification System

Distributed Notification System

A stateful distributed notification system written in Go, leveraging Raft for resilient, strong consistency, and fully Kubernetes-ready

Data Transformation Tool

Data Transformation Tool

A Go-based serverless application on AWS Lambda that leverages SQS and Terraform to convert database data into ready-to-use machine learning datasets.

Buy-Better Admin API

Buy-Better Admin API

A stateless REST API developed in Go, utilizing a PostgreSQL database, and designed for production in a Kubernetes environment.

Buy Better Infrastructure

Buy Better Infrastructure

This repository centralizes Kubernetes resource files and Terraform configurations for GKE. It utilizes ArgoCD as part of the CI/CD pipeline to automate the deployment.

Buy Better System

Buy Better System

This document serves as the entry point for the Buy Better System. The system comprises eight sub-repositories and employs a technology stack that includes Go, TypeScript, Kubernetes, ArgoCD, and other technologies

Bund-Chain

Bund-Chain

Blockchain from scratch written in Go. Inspired by Bitcoin and Ethereum.

Facebook Crawler

Facebook Crawler

A web crawler designed for Facebook pages has been developed utilizing the Scrapy framework. This tool is effective for systematic data collection and analysis.

CTrader Algorithm Trading and Indicators

CTrader Algorithm Trading and Indicators

This repository contains some of my custom indicators and bot (Automate Trading) used in CTrader platform. Written in C#.

AI vs Pong - Deep Reinforcement Learning

AI vs Pong - Deep Reinforcement Learning

AI learned and played against Atari Pong using Pytorch framework and Atari gym

Autonomous Driving with CNN

Autonomous Driving with CNN

An Autonomous driving model using a CNN and Keras to predict steering angles. The environment utilized was the Udacity car simulator.

The Crew 2 and object detection

The Crew 2 and object detection

Real-time TensorFlow object detection used in the PC game.

This BNK48 does not exist

This BNK48 does not exist

A non-existent women's face was generated using StyleGAN from NVIDIA, based on the BNK48 dataset (a Thai idol girl group).

Oppomus

Oppomus

An open source parallel web crawler framework writing in python. Focus in parallel processing approach and provide a parallel control flow.

Thanyasit OS

Thanyasit OS

A Linux distribution that has the ability to translate the standard input from the echo command and produce the output in Thai language based on dictionary database using shell script.

Experience

Foundation

2013

Education

King Mongkut’s University of Technology Thonburi. Bachelor of Science, Computer Science (English Program)

Experience

- Built a Linux Operating System from Scratch (Linux From Scratch and Beyond Linux From Scratch)
- Developed a web application using PHP (CodeIgniter) to manage programming competitions. This application allows competitors to submit their code and receive immediate score reports from the server.

Early Experience

2013

Title

Python Developer @Diversition

Experience

- Developed an internal web crawling framework from scratch including a bot script to crawl for specific sites.

Advanced the career

2013

Title

Python Developer @Zyte (Formerly Scrapinghub)

Experience

- Developed a web crawler using the Scrapy framework and deployed it on the Zyte cloud platform
- Experienced in crawling various websites, from medical to e-commerce.
- Participated in a large-scale web crawling project.

Career Break

2018

Education

Self-Learning: Starting from basic math to Artificial Intelligence.

Experience

- Developed an autonomous driving system using a Convolution Neural Network to predict steering angles. The environment utilized was the Udacity car simulator.
- The Crew 2 and Object Detection: Real-time TensorFlow object detection used in the PC game.
- This BNK48 does not exist. A non-existent women's face was generated using StyleGAN from NVIDIA, based on the BNK48 dataset (a Thai idol girl group).

Freelancer and Consultant

2019

Title

Senior Web-Scraping Developer @Freelance

Experience

- Developed a web crawler using the Scrapy framework, Splash, and Playwright.
- Consulted and designed a scalable web scraping project.
- Delivered data/dataset to the client.
- Reversed engineer to understand how the website works.
- Implemented task automation based on client requirements.

Expanding Skills

2024

Education

Self-Learning: Backend, DevOps, Frontend.

Experience

- Implemented a blockchain from scratch using Go.
- Developed a stateless REST API using Go, leveraging PostgreSQL and ensuring it is ready for deployment on Kubernetes.
- Developed a stateful distributed notification system written in Go, leveraging Raft for resilient, strong consistency, and fully Kubernetes-ready

Reviews

  • Working with Thanyasit on our web scraping project was amazing! He crushed some really tricky tasks and made our data pipeline run so much better. On top of that, he's super easy to work with and a great team player. Can't recommend him enough!
    PawelTeam Lead
  • It was awesome working with Thanyasit on our big web scraping project. He’s one of the best developers I’ve met—super skilled, easy to work with, and great at solving tough problems. His expertise and positive vibe really made a difference!
    IonutProject Manager
  • Thanyasit has been a huge help in delivering the data we need for our projects. He’s quick, reliable, and always tackles tough scraping challenges with ease. The data he provides is clean and accurate, making my job so much easier. It’s been a pleasure working with him!
    YolladaData Scientist
  • Had a great time collaborating with Thanyasit on designing our large-scale web scraping system. He really knew his stuff and helped us figure out the best approach. Easy to work with and brought a lot of valuable insight to the project.
    PengyuSoftware Engineer
  • I had Thanyasit set up an automated system to buy an item at a specific time on an e-commerce site, and it works flawlessly! The process was smooth, and he made everything super easy to follow. Highly recommend his work!
    NithipanyaClient