Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud service). Beam also brings DSL in different languages, allowing users to easily implement their data integration processes. http://beam.incubator.apache.org/ Thu, 25 Feb 2016 15:04:09 -0800 Thu, 25 Feb 2016 15:04:09 -0800 Jekyll v3.1.1 <p>When the Apache Beam project proposed entry into the <a href="http://wiki.apache.org/incubator/BeamProposal">Apache Incubator</a> the proposal included the <a href="https://github.com/GoogleCloudPlatform/DataflowJavaSDK">Dataflow Java SDK</a>. In the long term, however, Apache Beam aims to support SDKs implemented in multiple languages, such as Python.</p> <!--more--> <p>Today, Google submitted the <a href="http://github.com/GoogleCloudPlatform/DataflowPythonSDK">Dataflow Python (2.x) SDK</a> on GitHub. Google is committed to including the in progress python SDK in Apache Beam and, in that spirit, we’ve moved development of the Python SDK to a public repository. While this SDK will not be included with the initial (incubating) releases of Apache Beam, our we plan on incorporating the Python SDK into beam during incubation. We want to take the time to implement changes from the <a href="https://goo.gl/nk5OM0">technical vision</a> into the Java SDK before we introduce a Python SDK for Apache Beam. We believe this will allow us to work on the model and SDKs in an ordered fashion.</p> <p>You can look for the Apache Beam Python SDK in the coming months once we finish forking and refactoring the Java SDK.</p> <p>Best,</p> <p>Apache Beam Team</p> Thu, 25 Feb 2016 13:00:00 -0800 http://beam.incubator.apache.org/beam/python/sdk/2016/02/25/beam-has-a-logo0.html http://beam.incubator.apache.org/beam/python/sdk/2016/02/25/beam-has-a-logo0.html beam python sdk <p>One of the major benefits of Apache Beam is the fact that it unifies both both batch and stream processing into one powerful model. In fact, this unification is so important, the name Beam itself comes from the union of <strong>B</strong>atch + str<strong>EAM</strong> = Beam</p> <p>When the project started, we wanted a logo which was both appealing and visually represented this unification. <!--more--> Thanks to the <strong>amazing</strong> work of Stephanie Smythies, the Apache Beam project now has a logo.</p> <p><em>drum roll</em> - <strong>Presenting, the Apache Beam Logo!</strong></p> <p><img src="/images/beam_logo_s.png" /></p> <p>We are excited about this logo because it is <strong>simple</strong>, <strong>bright</strong>, and shows the unification of bath and streaming, as beams of light, within the ‘B’. We will base our future website and documentation design around this logo and its coloring. We will also make various permutations and resolutions of this logo available in the coming weeks. For any questions or comments, send an email to the <code class="highlighter-rouge">dev@</code> email list for Apache Beam.</p> Mon, 22 Feb 2016 10:21:48 -0800 http://beam.incubator.apache.org/beam/update/website/2016/02/22/beam-has-a-logo.html http://beam.incubator.apache.org/beam/update/website/2016/02/22/beam-has-a-logo.html beam update website