In this article, we will integrate Apache Spark with delta lake to dump the data to minio storage.

Integrate Apache Spark With Delta Lake

In this article we will explore basics of  Apache Hadoop for big data processing in Java

Introduction to Apache Hadoop for big data processing in Java

We knew that Apace Spark- the most famous parallel computing model or processing the massive data set is written in Scala programming language. The Apace foundation offered a tool to support the Python in Spark which was named PySpark. The PySpark allows us to use RDDs in Python programming language through a library called Py4j. This article provides basic introduction about PySpark, RDD, MLib, Broadcase and Accumulator.

PySpark: Installation, RDDs, MLib, Broadcast and Accumulator

What if you could reliably run PHP without Nginx or Apache, but also without relying on its internal server? What if you could do async operations in PHP with true multi threading, fully taking advantage of multi core processors without hacks or a jungle of callbacks? What if you had drag and drop installation support for your PHAR packaged web apps in an environment identical to its production counterpart? Welcome to appserver.io – the worlds first open source application server for PHP.

Appserver.io – The First Multithreaded Application Server for PHP written in PHP

Bitcoin is an open source digital currency which could be transferred in a P2P payment network. It is decentralized and it is not controlled by any central authority or banks. It is transferred from person to person and no authority will be aware of your transaction. Its quite different from PayPal or Banks.

How Bitcoin works? A simple introduction.

Recently you might have seen many news that big organization like Redhat, Fedora, Wikipedia switched their database from MySQL. Now Google also going to join them. Why everyone want to move out of MySQL? It is once a popular and stable software. What is the reason behind and what are the possible alternatives.

Is it good time to switch from MySQL and choose some other database?

People who have taken programming as their career has to do coding for almost 30 years. Will they always get an opportunity to do complex tasks or to write project from scratch? The answer is NO. Sometimes they may get but not always. What should they do?

Why Experienced Programmers Should Contribute to Open Source

I could see many many students posting this question in many forums, I want to contribute to open source but How to contribute? There are many ways to do that. I have listed a few and I hope it might be useful.

How to contribute to open source

PrestaShop is an Open Source eCommerce Solution. It comes complete with over 310 features that have been carefully developed to assist business owners in increasing sales with virtually little effort. It is being used in more than 150,000 online stores.

PrestaShop - A feature rich Open Source eCommerce solution

What the benefit will i get, if i contribute to Open Source? This is the frequently asked question by many people. I just want to pen down the benefits which i know and i hope you will agree with it.

Benefits in contributing to Open Source

Open Source projects requires sponsors to fund their project. Few got good funding but few others are struggling to continue their project. A contributor, who does full time work in open source project requires funding to take care his needs. He has to be paid and he cannot do it for free. For those who don't get fund, check out this crowdfunding sites, these are exclusively for open source projects. Join these, get some fund and continue your dream.

Crowdfunding for Open Source Projects

You may require GBs of data to do performance or load testing. How your app behaves when there is loads of data.  You need to know the capacity of your application. This is the frequently asked question from the sales team "The customer is having 100GB of data and he wants to know whether our product will handle this? If so how much RAM / Disk storage required?". This article has pointers to the large data corpus.

10 sites to get the large data set or data corpus for free

Discover open source projects across all platforms

Featured posts

Integrate Apache Spark With Delta Lake

Introduction to Apache Hadoop for big data processing in Java

PySpark: Installation, RDDs, MLib, Broadcast and Accumulator

Topics

Most Popular

Suggested keywords:

Featured posts

Integrate Apache Spark With Delta Lake

Introduction to Apache Hadoop for big data processing in Java

PySpark: Installation, RDDs, MLib, Broadcast and Accumulator

Topics

Most Popular