A real time BigData system for analysis of online Persian Twitter data

Decription:

This Project is a group work with Armin Ayatollahi, Yara M. Bahram , mohammad-nili. in this project we used online Persian Twitter data for Designing a real-time system. For analyzing the content of Persian tweets, we developed a complete data processing line, starting with collecting data and sending it to Elastic Search, processing and storing hashtag/channel history in Cassandra, saving real-time statistics in Redis, and statistical analysis of data to The help of Superset/Clickhouse was formed and the centrality of data transfer was with Kafka.