#JetBrains 六折贺新春!IntelliJ IDEA,PyCharm,WebStorm,PhpStorm 优惠!
Apache MRQL 0.9.4-incubating 发布,此版本是第二个发布的版本,现已提供下载:
http://www.apache.org/dyn/closer.cgi/incubator/mrql
更新内容:
- [MRQL-45] Add support for Apache Flink
- [MRQL-49] Add Flink support info on the project web site
- [MRQL-63] Add support for MRQL streaming in spark streaming mode
Bugs 修复
- [MRQL-41 ] Post-release improvements
- [MRQL-42] Fix bug in XML projections
- [MRQL-44] Fix the map-reduce join for a complex reducer on map-reduce mode
- [MRQL-46] MRQL does not build with Java 8
- [MRQL-47] Fix various bugs for the Flink evaluation mode
- [MRQL-48] Fix global variable bindings in Spark and Flink modes
- [MRQL-50] Fix result dumping to a text file in Flink mode
- [MRQL-51] Support for Spark 1.1.0
- [MRQL-52] Fix Flink evaluation mode to pass all Junit tests
- [MRQL-53] Fix processing of directories of text files in MapReduce mode
- [MRQL-58] Fix config file and shell run scripts to support multiple HDFS users
- [MRQL-60] Fix building dependencies for hadoop 1.x
- [MRQL-61] Fix bug on select over union queries
- [MRQL-62] Fix Map-Reduce mode on MultipleInput sources
- [MRQL-67] Fix maven build errors for JDK 1.8
改进
- [MRQL-43] Add support for tracing
- [MRQL-54] Adjust the split size of a map-reduce input file based on the number of requested nodes
- [MRQL-55] Add support for Hadoop Sequence input format in flink mode
- [MRQL-56] Improve total aggregations and repetitions with shared results in Flink mode
- [MRQL-57] Make floating-point literals to be double instead of float
任务
- [MRQL-64] Prepare for 0.9.4 release
发行说明:
http://mrql.incubator.apache.org/ReleaseNotes-0.9.4.html
MRQL (发音 miracle) 是一个查询处理和优化系统,适用于大规模分布式的数据分析。MRQL (MapReduce Query Language) 是一个在计算机集群中对大规模数据的类 SQL 查询语言。MRQL 查询处理系统可使用如下三种模式评估 MRQL 查询:
- 使用 Hadoop 的 Map-Reduce 模式
- 使用 Apache Hama 的 BSP 模式 (Bulk Synchronous Parallel mode)
- 基于 Apache Spark 的 Spark 模式