A High-Performance Approach to Real-Time Big Data Collection, Storage, and Analysis

Abstract: Twitter is a well-known social media platform that has stood a test of time. a large majority of people chose Twitter as their social media channel of choice for trustworthy scientific news and information in many global communities. However, the constraints of The development of affordable data science is hindered by the Twitter app software interface (API). solutions for academic institutions. To fully utilise the data analytics offered by Researchers must pay considerable expenses in order to use Twitter with a free API account. We introduce our big data analytics tool This piece, it was created at Lakehead the University's DaTALab in Canada and lets users to quickly access vast amounts of Twitter data while focus on their search criteria on Twitter. The platform makes it easy to gather net data, which is subsequently cleared up using A series of filters before artificial intellect (AI) is used and ML systems. (AI). Our main area of concentration has been healthcare-related research, demonstrating the platform's potency. The platform itself, however, is adaptable to any intriguing subject. The data. was gathered and processed can be used for additional AI/ML analysis. To highlight the effectiveness of our system for upcoming healthcare research projects, we demonstrate our platform utilising a specific search topic. Index Terms— Big data, social intelligence, analytics, web-based, robotic intelligence (AI), and data mining.