9 Ways To Sort Files In Linux Environment

We bring you a tutorial that assists you in sorting files on Linux in different ways. 

Sorting files is important for meaningful output and is useful while dealing with DB files, CSV, xls, log files and text files. By default, the sort command will sort according to alpha-bates, sorting according to single character vertically. If it finds the same character in two lines, then it will move on to sort the second character.

There are 9 ways to do that according to www.linuxnix.com. You can mix and match them as per your requirement.

• 1:To sorting file names according to alpha-bates: sort filename.txt.

• 2: If you have a file with host names in the third column, to sort it according to the column, use K for sorting that. Like, sort k3 filename.txt.

• 3: To sort/ etc/password file according to home directories, sort will by default take space/tabs as field separators. In etc/passwd file, the field separator is : and this can be done with t option. sort -t: -k6 /etc/passwd 

• 4: To sort according to number, etc/passwd file according to UID, use -n option to do that. Sort will not understand numbers by default, so, use -n to make sure sort command understands it.sort -n -t: -k3 /etc/passwd. Without -n option sort will by default sort only first numerical char. 

• 5: Sort the file and reverse the order. sort -r filename.txt

• 6: Sometimes, it is required to sort the file and display only unique values. sort -u filename. 

• 7: To sort a file according to your requirement and save it to a different file, use -o option, to save the sorted output to a file. sort -o temp.txt filename.txt

• 8: If you have file content with sizes like 10K, 20G, 45M, 32T etc, you can sort according to human readable by using -h option. This will work on RHEL5 and above versions. sort -h filename.txt 

• 9: To check if the file is already sorted or not by using -c option. This will show you the first occurrence value. sort -c filename.txt

15 'Big Data' Facts Every IT Professional Should Know!

Big data is certainly the talk of the town lately! It is one of the fast growing technologies that can help you get jobs with the tech biggies. More and more firms now believe that big data will help businesses make better decisions in the days to come (some believe it's already started). However, there is dearth of right skills in the market.

As such, IT professionals should keep track of big data trends, research and statistics!

1. How Much Data is There?

-According to IBM, a whopping 2.5 quintillion bytes of data is created every day! 

2. Structured Versus Unstructured Data

-According to Tata Consultancy Services Limited (TCS): 51 per cent of data is structured, 27 per cent is unstructured while 21 per cent is semi-structured.

3. Big Data Generates Jobs

-According to Gartner, as much as 4.4 million IT jobs will be created globally to support big data by 2015. The technology will generate 1.9 million IT jobs in the US alone.

4. The Big Data Talent Shortage

-According to McKinsey Global Institute, the US alone could face a talent shortage of 140,000 to 190,000 people by 2018. Further, it could face a shortage of 1.5 million managers and analysts to make effective decisions on big data. 

5. Rethinking Job Roles and Titles

-According to TEK Systems, nearly 81 percent of IT leaders and 77 percent of IT professionals believe there is a considerable shortage of talent that could make best use of their organisation's data assets. 

6. Disparate Systems

-According to TEK Systems, 66 per cent of IT leaders and 53 per cent of IT professionals believe their organisations need to build new platforms to make use of their mammoth data management needs, thereby getting rid of current disparate systems. 

7. Getting Business Value From Big Data

-Tata Consultancy Services Limited has highlighted three prominent challenges for companies: making businesses share information across organisational lines; dealing with the three V's of big data (data volume, velocity and variety). Meanwhile, third on the list is determining which data could be best used under different conditions. 

8. Data Quality

-According to TEK Systems, 57 per cent of IT leaders and 52 per cent of IT professionals claim they don't always know who owns the data, meaning quality more or less lies on the back burner. Ensuring the accuracy and quality of the data will be critical in the times to come in an ever expanding universe of big data.

9. Create a Stronger Business

-According to CompTIA nearly eight in 10 data executives believe that harnessing all of their enterprise data would result in a stronger business.

10. Better Manage Data

-According to CompTIA less than 1 in 5 businesses report being currently stable in managing and using data. 

11. Top 3 Big Data Business Drivers

-According to EMA and 9sight Consulting, the top three big data business drivers include:

1. Speeding time for operational or analytical workloads (39 per cent)

2. Increasing competitive advantage with flexibility of data used in business solutions (34 per cent)

3. Business requirements for higher levels of advanced analytics (31 per cent)

12. Big Data Implementations

-According to EMA and 9sight Consulting, big data implementations in production rose from 27 per cent in 2012 to 34.3 per cent in 2013.

13. Big Data Tools

-According to Giga Spaces, nearly 80 per cent people in IT are either using or planning to use dedicated big data tools to manage massive amounts of data in their organisation.

14. Big Data Spending

-According to Tata Consultancy Services Limited, nearly 15 per cent of the companies surveyed had spent at least $100 million each on big data in 2012, while 7 per cent had invested at least $500 million.

15. Industries Spending the Most on Big Data

-According to Tata Consultancy Services Limited travel-related, high tech, and banking industries have been the biggest spenders, while industries related to life sciences, retail, and energy have spent the least. 

15 'Big Data' Facts Every IT Professional Should Know!

Big data is certainly the talk of the town lately! It is one of the fast growing technologies that can help you get jobs with the tech biggies. More and more firms now believe that big data will help businesses make better decisions in the days to come (some believe it's already started). However, there is dearth of right skills in the market.

As such, IT professionals should keep track of big data trends, research and statistics!

1. How Much Data is There?

-According to IBM, a whopping 2.5 quintillion bytes of data is created every day! 

2. Structured Versus Unstructured Data

-According to Tata Consultancy Services Limited (TCS): 51 per cent of data is structured, 27 per cent is unstructured while 21 per cent is semi-structured.

3. Big Data Generates Jobs

-According to Gartner, as much as 4.4 million IT jobs will be created globally to support big data by 2015. The technology will generate 1.9 million IT jobs in the US alone.

4. The Big Data Talent Shortage

-According to McKinsey Global Institute, the US alone could face a talent shortage of 140,000 to 190,000 people by 2018. Further, it could face a shortage of 1.5 million managers and analysts to make effective decisions on big data. 

5. Rethinking Job Roles and Titles

-According to TEK Systems, nearly 81 percent of IT leaders and 77 percent of IT professionals believe there is a considerable shortage of talent that could make best use of their organisation's data assets. 

6. Disparate Systems

-According to TEK Systems, 66 per cent of IT leaders and 53 per cent of IT professionals believe their organisations need to build new platforms to make use of their mammoth data management needs, thereby getting rid of current disparate systems. 

7. Getting Business Value From Big Data

-Tata Consultancy Services Limited has highlighted three prominent challenges for companies: making businesses share information across organisational lines; dealing with the three V's of big data (data volume, velocity and variety). Meanwhile, third on the list is determining which data could be best used under different conditions. 

8. Data Quality

-According to TEK Systems, 57 per cent of IT leaders and 52 per cent of IT professionals claim they don't always know who owns the data, meaning quality more or less lies on the back burner. Ensuring the accuracy and quality of the data will be critical in the times to come in an ever expanding universe of big data.

9. Create a Stronger Business

-According to CompTIA nearly eight in 10 data executives believe that harnessing all of their enterprise data would result in a stronger business.

10. Better Manage Data

-According to CompTIA less than 1 in 5 businesses report being currently stable in managing and using data. 

11. Top 3 Big Data Business Drivers

-According to EMA and 9sight Consulting, the top three big data business drivers include:

1. Speeding time for operational or analytical workloads (39 per cent)

2. Increasing competitive advantage with flexibility of data used in business solutions (34 per cent)

3. Business requirements for higher levels of advanced analytics (31 per cent)

12. Big Data Implementations

-According to EMA and 9sight Consulting, big data implementations in production rose from 27 per cent in 2012 to 34.3 per cent in 2013.

13. Big Data Tools

-According to Giga Spaces, nearly 80 per cent people in IT are either using or planning to use dedicated big data tools to manage massive amounts of data in their organisation.

14. Big Data Spending

-According to Tata Consultancy Services Limited, nearly 15 per cent of the companies surveyed had spent at least $100 million each on big data in 2012, while 7 per cent had invested at least $500 million.

15. Industries Spending the Most on Big Data

-According to Tata Consultancy Services Limited travel-related, high tech, and banking industries have been the biggest spenders, while industries related to life sciences, retail, and energy have spent the least.