Pyspark programming language enables easy deployment of complex ML algorithm on Big Data. Before working on larger dataframes, it becomes crucial to process data well. To process data, removing duplicate records is one important aspect. Many a time data quality

Read More

Quality of data can be good or can some time not be good enough as per expectations. There may be some data cleaning requirement for many cases. Sometime the column names are not up to the mark and can have

Read More