flink

开源

阿帕奇闪烁

26.2K stars0 点赞0 次浏览

工具介绍

阿帕奇闪烁

Apache Flink Apache Flink是一个开源流处理框架,具有强大的流和批量处理能力. 在https://flink.apache.org/上更多地了解Flink 特征基于不同时间语义(事件时间,处理时间)的数据流模式灵活窗口化(时间,计数,会话,自定义触发),支持批量处理和数据流程序的第一个运行时间 Elegant and slient API在Java A运行时间支持非常高的吞吐量和低事件时滞,同时支持在DataStream API中的事件时间和出门处理. 对精确的一接处理的过错容忍保证了流出程序中的自然后压图书馆用于图处理(批发),机器学习(批发),以及复杂事件处理(流发)自定义内存管理,以便在in-m之间高效而有力的切换.

核心特点

•A streaming-first runtime that supports both batch processing and data streaming programs
•Elegant and fluent APIs in Java
•A runtime that supports very high throughput and low event latency at the same time
•Support for *event time* and *out-of-order* processing in the DataStream API, based on the *Dataflow Model
•Flexible windowing (time, count, sessions, custom triggers) across different time semantics (event time, processing time)
•Fault-tolerance with *exactly-once* processing guarantees
•Natural back-pressure in streaming programs
•Libraries for Graph processing (batch), Machine Learning (batch), and Complex Event Processing (streaming)
•Custom memory management for efficient and robust switching between in-memory and out-of-core data processing algorithms
•Compatibility layers for Apache Hadoop MapReduce