I am presently advancing a real-time big data analytics system, managing and evolving a data pipeline with the capacity to process an astounding 18 terabytes of data per hour, while achieving an impressive throughput of 80K transactions per second, all processed in under a minute with realtime joining of different streams.