Big data class project 2020

Let’s explore the final project from our big data class as following. This year we have 7 projects. They look pretty good to me.

Feel free to clap or comment the ones you like.

1. Log analysis:

Centralized Logging Filebeat+Logstash+ Kafka + Elastic + kibana by poon & asamaporn

https://poonsht.medium.com/centralized-logging-%E0%B8%94%E0%B9%89%E0%B8%A7%E0%B8%A2-kafka-elastic-stack-b5314e4ec0a6

2. Log analysis:

NGINX log + filebeat+ elastic+ kibana by wattanai & anawin

Nginx log monitoring with Elasticsearch Ecosystem

3. Music recommendation:

Spotify music log csv + pyspark + elastic + kibana by nattamon & poksin

วิเคราะห์ข้อมูลการฟังเพลงใน Spotify โดยใช้เทคโนโลยี big data

4. Thai water level analysis:

CSV data + Hive, pyspark+ tableau by lattawit & sivakorn

Analytics and Visualization of Thai Water Level Data | การ Process Big data ผ่าน Hive pySpark และ…

5. New feed classification:

RSS data source + kafka + pyspark+ logstash + elastic + kibana by Thitiwat & Theerathat

https://thtiiz.medium.com/text-classification-on-rss-news-feeds-3c26a1050f63

6. System monitoring

system Log + logstash + elastic + kibana by nopparat & sarin

System Monitoring Visualization System (SMVS)

7. PM2.5

CSV + pyspark + elastic + kibana by Weeya, Paweerat & Jitlada

PM2.5 prediction & visualization; Using PySpark Machine Learning, Elasticsearch, and Kibana — Part1