lab3: commited by sgtote

lab3/file3

-test file 3

lab3/inlab/ProblemStatementInLab3.txt

+Advanced SED and AWK Problem Statement
+*******************************************************************************************************
+------------------------------------------------------
+Solving Instructions for inlab assignment
+------------------------------------------------------
+
+Strictly follow the instructions given below:
+
+1. Solution for each assignment is to be typed into the .sh or .sed or .awk file already kept inside the corresponding folder.  
+
+2.  Remember, you need to  change the permission of the .sh file before executing it: 
+    ​   chmod u+x     ​ <scriptfile>  or chmod 777 <scriptfile>
+
+3. Do not change the structure and the names.. The automatic checker will give you a 
+“not­submitted” grade otherwise, if it does not find the names. 
+ 
+4. Remember to follow the exact output formats specified. Extra characters will lead to incorrect evaluation by automatic checker. 
+
+5. See the sample_input and sample_output for actual folder which is given in testcase directory of each problem. 
+
+5. Inside the script if you use any temporary file, write command to remove it after the 
+operation within that script only. 
+
+6. To check your solution run the script test.sh given in corresponding folder.
+
+-----------------------------------------------------------
+Submission Guidelines for assignment - (5 marks, 0 to be awarded in case these are not followed)[to be followed for both inlab and outlab]
+-----------------------------------------------------------
+1. Create a file readme.txt  in lab#rollno.1_rollno.2_rollno.3_rollno.4 directory, which contains contribution of each team member and references (cite where you get code/code snippets from).
+
+2. Rename the directory lab#rollno.1_rollno.2_rollno.3_rollno.4 to actual lab number instead of #, replace the rollno.N with your respective roll numbers.
+
+3. Compress the directory to <team_name>.tar.gz
+
+4. Submit one assignment per team. 	
+
+*******************************************************************************************************
+
+In-lab Assignment
+
+-------------------------------------
+Problem 1:
+-------------------------------------
+You are a cracker(an unethical hacker is called a ‘cracker’) and you plan to mint money from a wealthy organization by blackmailing them. You happen to come across a scandalous document which proves that many employees of that organization were involved in a sham that occurred few years ago. 
+You are going to ask for a ransom in exchange of keeping the document secret. To start off, you must extract all the email IDs mentioned in the document for sending a threatening message.
+
+So, write a shell script ‘script1.sh’ that will extract all the valid email IDs from a given text file and print them on the terminal (one email ID in one line).
+
+Email id Format: {contains only letters,digits, ‘.’  and ‘_’ }@{letters and ‘.’ only}
+Some valid email IDs are given below:
+
+champak@xyz.com
+supandi@yahoo.co.in
+tumtum@cse.iitb.ac.in	
+huk_um.chalisa123@gmail.com
+
+Invalid email IDs :
+dha#csg@gmail.com
+Rham.hsdfk.234.456
+
+The script output will be graded programmatically, and any idiosyncrasies shall lead to deduction of marks.
+
+How to execute:
+./script1.sh <inputFileName>
+(here filename is passed as an ARGUMENT and NOT AS AN INPUT STREAM)
+
+
+
+
+-------------------------------------
+Problem 2:
+-------------------------------------
+
+Your computer networks project deadline is knocking on the doors and you have a considerable amount of work left. A major portion of the project requires you to validate IP addresses and map the valid IP addresses to their respective classes. 
+
+You have a text file of a log that contains some addresses and you want to write a script that will automate this task. [Input]
+
+Write a shell script that will extract valid IP addresses from a given text. For every valid IP address found, print its corresponding class.
+
+You should write your script in 'script2.sh' file provided inside the directory. If there are 'n' valid IP addresses in your script, then your output should be 'n' IP addresses followed by their class separated by a space. 
+
+IPv4 Format:
+w.x.y.z , where w,x,y,z are in range [0,255].
+Class A :  w is in range [0,127]
+Class B :  w is in range [128,191]
+Class C :  w is in range [192,223]
+Class D :  w is in range [224,239]
+Class E :  w is in range [240,247]
+Not Defined : w is in range [248,255]
+
+How to execute:
+./script2.sh <inputFileName>
+(here filename is passed as an ARGUMENT and NOT AS AN INPUT STREAM)
+
+Print the output on the terminal itself.
+e.g., if the given text contains 3 valid IP addresses, then your output should look like:
+
+10.12.144.36 A
+178.152.36.45 B
+192.168.12.1 C
+232.56.23.1 D
+245.23.123.234 E
+250.2.3.45 Not Defined
+
+
+
+
+
+
+-------------------------------------
+Problem 3:
+-------------------------------------
+
+Your friend has completed his CS101 assignment and you feel numb that you could not even started it. In the end, you are just bothered with marks and simply want to come crawling out of the course. After getting a papercut you have decided to get it from him over e-mail, and not write it down. You are dead from the inside and breaking the habit of being able to copy an assignment and/or thinking what i’ve done after every submission, is getting harder day by day. 
+
+The first step to copying an assignment is ensuring you do not get caught when you submit it; the little things give you away.
+
+You want to remove all the comments from his assignment to get one step closer to the submission. [We won’t mind if the readme of this assignment contains the name of “you-know-what” we are referring to in the text above” ;) ]
+
+Strong disclaimer: We do not encourage you to copy assignments at all. In the words of Arnab Goswami - “Never ever! Ever Ever!” The consequences of getting caught in this department are pretty rough. You do not believe me? Ask your seniors what a D-ADAC is!
+
+Write a SED script “script3.sed”  which cleans both kinds of comments from the C file (// and /* */ - single line and multi line) and prints the cleaned code on the terminal (no printing in a separate file; no output file to be generated).
+
+The script output in the input file itself will be graded programmatically, and any idiosyncrasies shall lead to deduction of marks.
+
+Input :
+C program file name
+sed -f script3.sed <inputFile>
+(here filename is passed as an ARGUMENT and NOT AS AN INPUT STREAM)
+
+Output:
+Cleaned C program on the terminal.
+
+
+
+
+-------------------------------------
+Problem 4:
+-------------------------------------
+
+A program written by you gets the input from an embedded systems device (Joystick on a gamepad) through a serial port on your machine. The program generates output in the following format:
+
+    1,X!2,Y!3,Z!2.5,O!
+
+where the , denotes a field separator and ! denotes a record separator.
+
+Write an awk program script4.awk which takes as an input argument a file of the format specified above and generates the output on command line (prints the output; not in a file, for the n-th time, not in a file) of this format:
+
+How to Execute:
+awk -f script4.awk <inputFile>
+(here filename is passed as an ARGUMENT and NOT AS AN INPUT STREAM)
+
+Output:
+Value	SensorNumber
+1	X
+2	Y
+3	Z
+2.5	O
+
+The above should be the output on the command line and nothing else should be generated, not a file, not anything extra written. The script output will be graded programmatically, and any idiosyncrasies shall lead to deduction of marks.
+
+
+
+
+-------------------------------------
+Problem 5:
+-------------------------------------
+Your 9 year old brother is facing lot of problems at school. One of his classmates has taken a liking to his tiffin and snatches his food every day. As a result, your brother is not able to eat the delicious tiffin that your mother cooks for him. 
+Your brother wants to complain to his class teacher but he doesn’t know english well. He uses too many words starting and ending with vowels. You want to find those words from his note.
+
+Write a shell script ‘script5.sh’ that finds all the DISTINCT words that start and end with a vowel in a file.
+
+Your output will be all the words that start and end with a vowel. You should print one word in each line(SORTED ORDER). Print the output on the terminal itself.
+
+
+How to execute:
+./script5.sh <inputFileName>
+(here filename is passed as an ARGUMENT and NOT AS AN INPUT STREAM)
+
+Sample Output:
+Aeroplane
+Atacama
+Eye
+Ogre
+
+
+
+
+-------------------------------------
+Problem 6:
+-------------------------------------
+
+You have come across a large corpus (text document), and want to create a dictionary out of it. A dictionary is a collection of unique words here in this context, but in a particular format. The format is:
+
+Every word has been converted to lowercase.
+All punctuation marks are removed, and not to be considered as words.
+
+The input file shall contain paragraphs and the dictionary shall be a simple list of words contained in the file. Write a Bash script ‘script6.sh’ which uses AWK, SED or whatever you would like to use to create such a dictionary from a corpus provided as an input argument to the script.
+
+The dictionary should be printed on the terminal(IN SORTED ORDER) and not output to a file. The input argument would be a file which contains the text.
+
+E.g.
+Input file contains:
+We are the students of IIT Bombay, we are here to learn Computer Science and Engineering. We were surprised to know that our TA’s are themselves students from the same institute.
+
+Output (likely):
+and
+are
+bombay
+computer
+.
+.
+.
+surprised
+ta’s
+that
+the
+themselves
+to
+we
+were
+
+
+So, remove all the punctuation marks at the end of the words, or at the beginning. The ones within the words should stay where they are (e.g. TA’s -> ta’s) 

lab3/inlab/lab3_160050049_160050108_160050009/Problem1/script1.sh

+#!/bin/bash
+
+while read line || [[ -n "$line" ]]
+do
+	for word in $line
+	do
+		OLDIFS=$IFS
+		IFS=",;!?"
+		for part in $word
+		do
+			if [[ $part =~ ^[a-zA-Z]+[a-zA-Z0-9._]*+@+[a-zA-Z.]*+\.+[a-zA-Z.]*$ ]]
+				then 
+				echo $part
+			fi
+		done
+		IFS=$OLDIFS
+	done
+done < "$1"
\ No newline at end of file

lab3/inlab/lab3_160050049_160050108_160050009/Problem1/test.sh

+./script1.sh testcase/input1 > out
+
+diff testcase/output1 out > result
+
+if [[ -s result ]];
+then
+	echo failed
+else
+	echo passed
+fi
+rm out result

lab3/inlab/lab3_160050049_160050108_160050009/Problem1/testcase/input1

+Electronic mail is a method of exchanging digital messages between computer users; such messaging first entered substantial use in the 1960s and by the 1970s had taken the form now recognised as email. These are spams email ids: 
+intizar_08@yahoo.co.in , manu29809@gmail.com, pankajdhaka.dav@hotmail.com, pranav165@yahoo.com .
+
+These are ok emails :
+arya.anit3@gmail.com ; meetshrotriya@gmail.com ;  vikas221965@yahoo.com ; manugarg1592@yahoo.in
+praveen_solanki29@yahoo.com.
+tanmaysharma07@gmail.com
+kartikkumar781@gmail.com
+arun.singh2205@gmail.com
+
+sukalyan_bhakat@us.in.y.z
+These are incorrect:
+
+rohitneema065@gmail
+shashikant.1975.com
+ram#dhar@gmail.com
+123aahdhf@gmail.com
+_rma2367@gmail.com
+Corruption not only has become a pervasive aspect of shukalyan24738.sdfj@gmail.com Indian politics but also has become an increasingly important factor in Indian elections.
+
+
+The extensive role of the Indian state in providing services and promoting economic ram@cse.iitb.ac.in development has always created the opportunity for using public resources for private benefit.
+
+
+
+As government regulation of business was extended in dharm@yahoo.com the 1960s and corporate donations were banned in 1969, trading economic favours for under-the-table contributions to political parties became an increasingly widespread political practice. During the 1980s and 1990s, corruption became associated with the occupants of the highest echelons of India’s political system.
+
+Rajiv Gandhi’s government was rocked by scandals, as was the government rohit@cse.iitb.ac.in of P.V. Narasimha Rao. Politicians have become so closely identified with corruption in the public eye that a Times of India poll of 1,554 adults in six metropolitan cities found that 98 percent of the public is convinced that politicians and ministers are corrupt, with 85 percent observing that corruption is on the increase.
+
+The prominence of political corruption in India in the 1990s is hardly unique to India. Other abhijitpatil@gmail.com countries also have experienced corruption that has rocked their political systems. What is remarkable about India is the persistent anti-incumbent sentiment among its electorate. Since Indira’s victory in her 1971 “garibi hatao” election, only one ruling party has been re-elected to power in the Central Government.
+
+In an important sense, the exception proves the rule because diptesh_23x@yahoo.com the Congress (I) won reelection in 1984 in no small measure because the electorate saw in Rajiv Gandhi a “Mr. Clean” who would lead a new generation of politicians in cleansing the political system. Anti-incumbent sentiment is just as strong at the state level, where the ruling parties of all political persuasions in India’s major states lost eleven of thirteen legislative assembly elections held from 1991 through spring 1995.
+
+
+
+Corruption in simple terms may be rohit@yahoo.co.in described as ‘an act of bribery’. Corruption is defined as the use of public office for private gains in a way that constitutes a breach of law or a deviation from the norms of society. Scales of corruption can be Grand, Middling or Petty and payment of bribes can be due to collusion between the bribe taker and the bribe giver, due to coercion or even anticipatory.
+
+This was the outburst of Mahatma Gandhi against rampant deepak@iitb.ac.in corruption in Congress ministries formed under 1935 Act in six states in the year 1937. The disciples of Gandhi however, ignored his concern over corruption in post-Independence India, when they came to power.
+
+Over sixty years of democratic rule has made the people so immune to corruption that they have learnt how to live with the system even though the cancerous growth of this malady may finally kill it. The Tehelka episode surcharged the political atmosphere of the country but it hardly exposed anything that was unknown to the people of this biggest democratic polity.
+
+Politicians are fully aware of the corruption and nepotism as the main reasons behind the fall of Roman Empire, the French Revolution, October Revolution in Russia, fall of Chiang Kai-Shek Gov­ernment on the mainland of China-and even the defeat of the mighty Congress party in India. But they are not ready to take any lesson from the pages of history.
+
+

lab3/inlab/lab3_160050049_160050108_160050009/Problem1/testcase/input1Problem1

+Electronic mail is a method of exchanging digital messages between computer users; such messaging first entered substantial use in the 1960s and by the 1970s had taken the form now recognised as email. These are spams email ids: 
+intizar_08@yahoo.co.in , manu29809@gmail.com, pankajdhaka.dav@hotmail.com, pranav165@yahoo.com .
+
+These are ok emails :
+arya.anit3@gmail.com ; meetshrotriya@gmail.com ;  vikas221965@yahoo.com ; manugarg1592@yahoo.in
+praveen_solanki29@yahoo.com
+tanmaysharma07@gmail.com
+kartikkumar781@gmail.com
+arun.singh2205@gmail.com
+
+sukalyan_bhakat@us.in.y.z
+These are incorrect:
+
+rohitneema065@gmail
+shashikant.1975.com
+ram#dhar@gmail.com
+123aahdhf@gmail.com
+_rma2367@gmail.com
+Corruption not only has become a pervasive aspect of shukalyan24738.sdfj@gmail.com Indian politics but also has become an increasingly important factor in Indian elections.
+
+
+The extensive role of the Indian state in providing services and promoting economic ram@cse.iitb.ac.in development has always created the opportunity for using public resources for private benefit.
+
+
+
+As government regulation of business was extended in dharm@yahoo.com the 1960s and corporate donations were banned in 1969, trading economic favours for under-the-table contributions to political parties became an increasingly widespread political practice. During the 1980s and 1990s, corruption became associated with the occupants of the highest echelons of India’s political system.
+
+Rajiv Gandhi’s government was rocked by scandals, as was the government rohit@cse.iitb.ac.in of P.V. Narasimha Rao. Politicians have become so closely identified with corruption in the public eye that a Times of India poll of 1,554 adults in six metropolitan cities found that 98 percent of the public is convinced that politicians and ministers are corrupt, with 85 percent observing that corruption is on the increase.
+
+The prominence of political corruption in India in the 1990s is hardly unique to India. Other abhijitpatil@gmail.com countries also have experienced corruption that has rocked their political systems. What is remarkable about India is the persistent anti-incumbent sentiment among its electorate. Since Indira’s victory in her 1971 “garibi hatao” election, only one ruling party has been re-elected to power in the Central Government.
+
+In an important sense, the exception proves the rule because diptesh_23x@yahoo.com the Congress (I) won reelection in 1984 in no small measure because the electorate saw in Rajiv Gandhi a “Mr. Clean” who would lead a new generation of politicians in cleansing the political system. Anti-incumbent sentiment is just as strong at the state level, where the ruling parties of all political persuasions in India’s major states lost eleven of thirteen legislative assembly elections held from 1991 through spring 1995.
+
+
+
+Corruption in simple terms may be rohit@yahoo.co.in described as ‘an act of bribery’. Corruption is defined as the use of public office for private gains in a way that constitutes a breach of law or a deviation from the norms of society. Scales of corruption can be Grand, Middling or Petty and payment of bribes can be due to collusion between the bribe taker and the bribe giver, due to coercion or even anticipatory.
+
+This was the outburst of Mahatma Gandhi against rampant deepak@iitb.ac.in corruption in Congress ministries formed under 1935 Act in six states in the year 1937. The disciples of Gandhi however, ignored his concern over corruption in post-Independence India, when they came to power.
+
+Over sixty years of democratic rule has made the people so immune to corruption that they have learnt how to live with the system even though the cancerous growth of this malady may finally kill it. The Tehelka episode surcharged the political atmosphere of the country but it hardly exposed anything that was unknown to the people of this biggest democratic polity.
+
+Politicians are fully aware of the corruption and nepotism as the main reasons behind the fall of Roman Empire, the French Revolution, October Revolution in Russia, fall of Chiang Kai-Shek Gov­ernment on the mainland of China-and even the defeat of the mighty Congress party in India. But they are not ready to take any lesson from the pages of history.
+
+

lab3/inlab/lab3_160050049_160050108_160050009/Problem1/testcase/output1

+intizar_08@yahoo.co.in
+manu29809@gmail.com
+pankajdhaka.dav@hotmail.com
+pranav165@yahoo.com
+arya.anit3@gmail.com
+meetshrotriya@gmail.com
+vikas221965@yahoo.com
+manugarg1592@yahoo.in
+praveen_solanki29@yahoo.com
+tanmaysharma07@gmail.com
+kartikkumar781@gmail.com
+arun.singh2205@gmail.com
+sukalyan_bhakat@us.in
+dhar@gmail.com
+123aahdhf@gmail.com
+_rma2367@gmail.com
+shukalyan24738.sdfj@gmail.com
+ram@cse.iitb.ac.in
+dharm@yahoo.com
+rohit@cse.iitb.ac.in
+abhijitpatil@gmail.com
+diptesh_23x@yahoo.com
+rohit@yahoo.co.in
+deepak@iitb.ac.in

lab3/inlab/lab3_160050049_160050108_160050009/Problem1/testcase/output1Problem1

+intizar_08@yahoo.co.in
+manu29809@gmail.com
+pankajdhaka.dav@hotmail.com
+pranav165@yahoo.com
+arya.anit3@gmail.com
+meetshrotriya@gmail.com
+vikas221965@yahoo.com
+manugarg1592@yahoo.in
+praveen_solanki29@yahoo.com
+tanmaysharma07@gmail.com
+kartikkumar781@gmail.com
+arun.singh2205@gmail.com
+sukalyan_bhakat@us.in.y.z
+dhar@gmail.com
+shukalyan24738.sdfj@gmail.com
+ram@cse.iitb.ac.in
+dharm@yahoo.com
+rohit@cse.iitb.ac.in
+abhijitpatil@gmail.com
+diptesh_23x@yahoo.com
+rohit@yahoo.co.in
+deepak@iitb.ac.in

lab3/inlab/lab3_160050049_160050108_160050009/Problem2/script2.sh

+#!/bin/bash
+
+IFS="."
+
+grep -o ' [0-9][0-9]*\.[0-9][0-9]*\.[0-9][0-9]*\.[0-9][0-9]* ' $1 > temp
+sed -i 's/[ ]//g' temp
+while read n1 n2 n3 n4
+do
+	if [ "$n1" -le 127 ] && [ "$n2" -lt 256 ] && [ "$n3" -lt 256 ] &&[ "$n4" -lt 256 ]
+	then 
+		echo "$n1.$n2.$n3.$n4" A	
+	elif [ "$n1" -le 191 ] && [ "$n1" -ge 128 ] && [ "$n2" -lt 256 ] && [ "$n3" -lt 256 ] && [ "$n4" -lt 256 ]
+		then
+		echo "$n1.$n2.$n3.$n4" B
+	elif [ "$n1" -le 223 ] && [ "$n1" -ge 192 ] && [ "$n2" -lt 256 ] && [ "$n3" -lt 256 ] && [ "$n4" -lt 256 ]
+		then
+		echo "$n1.$n2.$n3.$n4" C
+	elif [ "$n1" -le 239 ] && [ "$n1" -ge 224 ] && [ "$n2" -lt 256 ] && [ "$n3" -lt 256 ] && [ "$n4" -lt 256 ]
+		then
+		echo "$n1.$n2.$n3.$n4" D
+	elif [ "$n1" -le 247 ] && [ "$n1" -ge 240 ] && [ "$n2" -lt 256 ] && [ "$n3" -lt 256 ] && [ "$n4" -lt 256 ]
+		then
+		echo "$n1.$n2.$n3.$n4" E
+	elif [ "$n1" -le 255 ] && [ "$n1" -ge 248 ] && [ "$n2" -lt 256 ] && [ "$n3" -lt 256 ] && [ "$n4" -lt 256 ]
+		then
+		echo "$n1.$n2.$n3.$n4" Not Defined
+	fi
+done < temp
+rm temp

lab3/inlab/lab3_160050049_160050108_160050009/Problem2/test.sh

+./script2.sh testcase/input2 > out
+
+diff -Z testcase/output2 out > result
+
+if [[ -s result ]];
+then
+	echo failed
+else
+	echo passed
+fi
+rm out result

lab3/inlab/lab3_160050049_160050108_160050009/Problem2/testcase/input2

+An Internet Protocol 172.16.254.1 address (IP address) is a numerical label assigned to each device connected to a computer network that uses the Internet Protocol for communication.[1] An IP address serves two principal functions: host or network interface 345.45.48.45 identification and location addressing.
+
+Version 4 of the Internet Protocol (IPv4) defines 256.2.3.5 an IP address as a 32-bit number.[1] However, because of the 78.54.259.6 growth of the Internet and the depletion of available IPv4 addresses, a new version of IP (IPv6), using 128 bits for the IP address, was developed in 1995,[2] and standardized as RFC 2460 in 1998.[3] IPv6 deployment has been ongoing since the mid-2000s.
+
+IP addresses are usually 192.45.78.248 written and displayed in human-readable notations, such as  in IPv4, and 2001:db8:0:1234:0:567:8:1 in IPv6.
+
+The IP address 489.56.49. space is managed globally by the 234.456.3.5 Internet Assigned Numbers Authority (IANA), and by five regional Internet registries (RIR) responsible in their designated territories for assignment 82.45.12.3 to end users and local Internet registries, such as Internet service providers. IPv4 addresses 1.0.1.289 have been distributed by IANA to the RIRs in blocks of approximately 16.8 million addresses each. Each ISP or private network administrator assigns 456.25.15.23 an IP address to each device connected to its network. Such assignments 240.2.1.3 may be on a static (fixed or permanent) or dynamic basis, depending on 45.2.1.45.48 its software and practices.
+
+An IP address serves two principal functions. It identifies the host, or more specifically its network interface, and it provides the location of the host in the network, and thus the 249.56.2.3 capability of addressing 45.89.12.45.36 that host. Its role has been characterized as follows: "A name indicates what we seek. An address indicates where it is. A route indicates how to get there."[4]
+
+The header of each IP packet contains the IP address of the 456.258.2.3 sending host, and that of the destination 0.0.0.0 host. A host may use geolocation software to deduce the geolocation 255.255.255.255 of its communicating peer.[5][6]
+
+wo versions of the Internet Protocol 12.59.126.23 are in common use in the Internet today. The original 123.45.78.1 version of the Internet Protocol for use in the Internet is Internet Protocol version 4 (IPv4), first installed in 1983.
+
+The rapid exhaustion of IPv4 address space available 195.26.56.45 for assignment to Internet service 56.236.256.4895 providers and end user organizations by the early 1990s, prompted the Internet Engineering Task Force (IETF) to explore new technologies to expand the addressing capability in the Internet. The result was a redesign 123.456.789.2 of the Internet Protocol which became eventually known as Internet Protocol Version 6 (IPv6) in 1995.[2][3] IPv6 technology was in various testing stages until the mid-2000s, when commercial production deployment commenced.
+
+IANA's primary IPv4 address pool was exhausted on 3 February 2011, when 250.0.0.0 the last five blocks were allocated to the five RIRs.[7][8] APNIC was the first RIR to exhaust its regional pool on 15 April 2011, except for a small amount of address space reserved for the transition to IPv6, intended to be allocated in a restricted process.[9] Individual ISPs still had unassigned pools of IP addresses, and could recycle addresses no longer needed by their subscribers.
+
+Today, these two versions of the Internet Protocol are in simultaneous 156.25.78.89 use. Among other technical changes, each version defines the format of addresses differently. Because of the historical prevalence of IPv4, the generic term IP address typically still refers to the addresses defined by IPv4. The gap in version sequence 0.0.0.0.0 between IPv4 and IPv6 resulted from the assignment of version 5 to the experimental Internet Stream Protocol in 1979, which however was never referred to as IPv5.
+
+
+
+
+
+
+An IP address in IPv4 is 32-bits in size, which limits the address space to 4294967296 (232) IP addresses. Of this number, IPv4 reserves some addresses for special purposes such as private networks (~18 million addresses) or multicast addresses (~270 million addresses).
+
+IPv4 addresses are usually represented in dot-decimal notation, consisting of four decimal numbers, each ranging from 0 to 255, separated by dots, e.g., 172.16.254.1 Each part represents a group of 8 bits (octet) of the address. In some cases of technical writing, IPv4 addresses may be presented in various hexadecimal, octal, or binary representations.
+
+
+n the early stages of development of the Internet Protocol,[1] network administrators interpreted an IP address in two parts: network number portion and host number portion. The highest order octet (most significant eight bits) in an address was designated as the network number and the remaining bits were called the rest field or host identifier and were used for host numbering within a network.
+
+This early method soon proved inadequate as additional networks developed that were independent of the existing networks already designated by a network number. In 1981, the Internet addressing specification was revised with the introduction of classful network architecture.[4]
+
+Classful network design allowed for a larger number 78.89.45.258 of individual network assignments and fine-grained subnetwork design. The first three bits of the most significant octet of an IP address were defined as the class of the address. Three classes (A, B, and C) were defined for universal unicast addressing. Depending on the 236.45.89.456 class derived, the network identification was based on octet boundary segments of the entire address. Each class used successively additional octets in the network identifier, thus reducing the possible number of hosts in the higher order classes (B and C). The following table gives an overview of this now obsolete system.
+
+
+
+IP addresses are assigned to a host either 456.23.56.48 dynamically at the time of booting, or permanently by fixed configuration of the host hardware or software. Persistent configuration is also known as using a static IP address. In contrast, when a computer's IP address is assigned newly each time it restarts, this is known as using a dynamic IP address.
+
+The configuration 0.1236.45.890 of a static IP address depends in detail on the 0.2.3.1 software or hardware installed in the computer. Computers used for the network infrastructure, such as routers and mail servers, are typically configured with static addressing, Static addresses are also sometimes convenient for locating servers inside an enterprise.[citation needed]
+
+Dynamic IP addresses 89.56.123.256 are assigned using 2.2.3.3.0.2.56 methods such as 236.2.56.45 Zeroconf for self-configuration, or by the Dynamic Host Configuration Protocol (DHCP) from a network server. The address assigned with DHCP usually has an expiration period, after which the address may be assigned to another device, or to the originally associated host if it is still powered up. A network administrator may implement a DHCP method so that the same host always receives a specific address.
+
+DHCP is the most frequently used technology for assigning 1236.23.5.1 addresses. It avoids the 230.56.19.68 administrative burden of assigning specific static addresses to each device on a network. It also allows devices to share the limited address space on a network if only some of them are online at a particular time. Typically, dynamic IP configuration is enabled by default in modern desk top operating systems. DHCP is not the only technology used to assign IP addresses dynamically. Dialup and some broadband networks use dynamic address features of the Point-to-Point Protocol.
+
+In the absence or failure of static or stateful (DHCP) address configurations, an operating system may assign an IP address to a network interface using state-less auto-configuration methods, such as Zeroconf.
+

lab3/inlab/lab3_160050049_160050108_160050009/Problem2/testcase/output2

+172.16.254.1 B
+192.45.78.248 C
+82.45.12.3 A
+240.2.1.3 E
+249.56.2.3 Not Defined
+0.0.0.0 A
+255.255.255.255 Not Defined
+12.59.126.23 A
+123.45.78.1 A
+195.26.56.45 C
+250.0.0.0 Not Defined
+156.25.78.89 B
+172.16.254.1 B
+0.2.3.1 A
+236.2.56.45 D
+230.56.19.68 D
+

lab3/inlab/lab3_160050049_160050108_160050009/Problem3/script3.sed

+#!/bin/bash
+
+s/\/\/.*//
+s/\(\/\*\)[^\*]*\(\*\/\)//g
\ No newline at end of file

lab3/inlab/lab3_160050049_160050108_160050009/Problem3/test.sh

+sed -f script3.sed testcase/input3 > out
+
+diff -Z out testcase/output3 > result
+
+if [[ -s result ]];
+then
+	echo failed
+else
+	echo passed
+fi
+rm out result

lab3/inlab/lab3_160050049_160050108_160050009/Problem3/testcase/input3

+#include<stdio.h>
+int main() {
+// this is a dummy function
+	// testing the sed commands.
+	
+	int x = 6;
+	/* logic starts from here*/
+	
+	x = x + 5;
+/* end of c asdasd*/
+
+}

lab3/inlab/lab3_160050049_160050108_160050009/Problem3/testcase/output3

+#include<stdio.h>
+int main() {
+
+	
+	
+	int x = 6;
+	
+	
+	x = x + 5;
+
+
+}

lab3/inlab/lab3_160050049_160050108_160050009/Problem4/script4.awk

+#!/bin/bash
+
+BEGIN { FS=","; RS="!"; OFS=""; print "Value\tSensorNumber"}
+{ print $1,"\t",$2 }
\ No newline at end of file

lab3/inlab/lab3_160050049_160050108_160050009/Problem4/test.sh

+awk -f script4.awk testcase/input41 > tmpout1
+diff -Z tmpout1 testcase/output41 > result1
+if [ -s result1 ]
+then 
+     echo "Test case-1 failed"
+else
+     echo "Test case-1 passed"
+fi
+
+
+awk -f script4.awk testcase/input42 > tmpout2
+diff tmpout2 testcase/output42 > result2
+
+if [ -s result2 ]
+then 
+     echo "Test case-2 failed"
+else
+     echo "Test case-2 passed"
+fi
+
+rm tmpout1 tmpout2 result1 result2
+
+
+
+

lab3/inlab/lab3_160050049_160050108_160050009/Problem4/testcase/input41

+1,Y!34,T!34,T!23,H!78,K!789,K!34,T!89,H!567,G!45,T!56,Z!5896,R!45,X

lab3/inlab/lab3_160050049_160050108_160050009/Problem4/testcase/input42

+2.3,T!8,Y!7,R!6.7,D!45,S!7.9,A!2,T!7,W!78.9,E!9.1,M!45.1,S!5.2,P!4,A!5,K

lab3/inlab/lab3_160050049_160050108_160050009/Problem4/testcase/output41

+Value	SensorNumber
+1	Y
+34	T
+34	T
+23	H
+78	K
+789	K
+34	T
+89	H
+567	G
+45	T
+56	Z
+5896	R
+45	X
+

lab3/inlab/lab3_160050049_160050108_160050009/Problem4/testcase/output42

+Value	SensorNumber
+2.3	T
+8	Y
+7	R
+6.7	D
+45	S
+7.9	A
+2	T
+7	W
+78.9	E
+9.1	M
+45.1	S
+5.2	P
+4	A
+5	K
+

lab3/inlab/lab3_160050049_160050108_160050009/Problem5/script5.sh

+#!/bin/bash
+
+word1="0"
+cat $1 | awk 'BEGIN {RS="[., ]"} { print $1 }' | grep -o '^[AEIOUaeiou].*[AEIOUaeiou]$' | sort |
+while read line
+do
+    for word in $line
+    do
+        if [ "$word" != "$word1" ]
+        	then
+        	word1=$word
+        	echo $word
+        fi
+    done
+done
\ No newline at end of file

lab3/inlab/lab3_160050049_160050108_160050009/Problem5/test.sh

+./script5.sh testcase/input5 > out
+
+diff testcase/output5 out > result
+
+if [[ -s result ]];
+then
+	echo failed
+else
+	echo passed
+fi
+rm out result

lab3/inlab/lab3_160050049_160050108_160050009/Problem5/testcase/input5

+We are the sum of experiences that we encounter as we go through life. 
+Day to day struggles and triumphs are experienced by all of the worlds creatures. 
+As human beings, when we encounter a challenge, we have freedom to choose how to react. 
+Every decision that we make leads us down a different road. We will never come to exactly the same crossroads. 
+Every decision that we make has significance. The tiniest choice that we make reverberates throughout the entire universe.
+I sleep in the clouds, dream in the sky,
+Ill keep dreaming as life passes me by,
+I think my dreams keep me sane,
+I dream of happiness, a life without pain,
+some people say Im stuck in this place,
+and Ill never go anywhere,
+but in my dreams Ive already been there,
+I know some day Ill have to wake up,
+but I feel the real world is more like a nightmare,
+Im safe in my closed eye wonderland,
+this poem goes to all the dreamers that understand,
+no matter what they say...
+keep your dreams but dont dream your life away,
+
+Electoral systems are the detailed constitutional arrangements and voting systems that convert the vote into a political decision. The first step is to tally the votes, for which various vote counting systems and ballot types are used. Voting systems then determine the result on the basis of the tally. Most systems can be categorized as either proportional or majoritarian
+
+When elections are called, politicians and their supporters attempt to influence policy by competing directly for the votes of constituents in what are called campaigns. Supporters for a campaign can be either formally organized or loosely affiliated, and frequently utilize campaign advertising. It is common for political scientists to attempt to predict elections via Political Forecasting methods
+
+Ransomware is a type of malware that prevents or limits users aMMA from accessing their system, either by locking the system's screen or by locking the users' files unless a ransom is paid. More modern ransomware families, collectively categorized as crypto-ransomware, encrypt certain file types on infected systems and forces users to pay the ransom through certain online payment methods to get a decrypt key.
+Ransom prices vary depending on the ransomware variant and the price or exchange rates of digital currencies. Thanks to the perceived anonymity offered by cryptocurrencies, ransomware operators commonly specify ransom payments in bitcoins. Recent ransomware variants ave also listed alternative payment options such as iTunes and Amazon gift cards. It should be noted, however, that paying the ransom does not guarantee that users will get the decryption key or unlock tool required to regain access to the infected system or hostaged files.
+Users may encounter this threat through a variety of means. Ransomware can be downloaded onto systems when unwitting users visit malicious or compromised websites. It can also arrive as a payload either dropped or downloaded by other malware. Some ransomware are known to be delivered as attachments from spammed email, downloaded from malicious pages through malvertisements, or dropped by exploit kits onto vulnerable systems.
+
+Once executed in the system, ransomware can either lock the computer screen, or, in the case of crypto-ransomware, encrypt predetermined files. In the first scenario, a full-screen image or notification is displayed on the infected system's screen, which prevents victims from using their system. This also shows the instructions on how users can pay for the ransom. The second type of ransomware prevents access to files to potentially critical or valuable files like documents and spreadsheets.
+
+Ransomware is considered scareware as it forces users to pay a fee (or ransom) by scaring or intimidati them. In this sense, it is similar to FAKEAV malware, but instead of capturing the infected system or encrypting files, FAKEAV shows fake antimalware scanning results to coax users into purchasing bogus antimalware software.
+
+But this massive wave wasn’t the only one. A few weeks later, a ransomware strain resembling Petya started spreading around Europe, affecting companies, Ukrainian institutions and banks, and even the even the radiation monitoring system at Chernobyl.
+
+Ransomware has been a growing trend for the past two years, and this is just a culmination, a grand reveal to the wider world of just how big of a threat it is. But we’ve been writing about this for a while now.
+
+The entity that creates the securities for sale is known as the issuer, and those that buy them are, of course, investors. Generally, securities represent an investment and a means by which municipalities, companies and other commercial enterprises can raise new capital. Companies can generate a lot of money when they go public, selling stock in an initial public offering, for example. City, state or county governments can raise funds for a particular project by floating a municipal bond issue. Depending on an institutions market demand or pricing structure, raising capital through securities can be a preferred alternative to financing through a bank loan.
+
+Bearer securities are those that are negotiable and entitle the shareholder to the rights under the security. They are transferred from investor to investor, in certain cases by endorsement and delivery. In terms of proprietary nature, pre-electronic bearer securities were always divided, meaning each security constituted a separate asset, legally distinct from others in the ame issue. Depending on market practice, divided security assets can be fungible or less commonly non-fungible, meaning that upon lending, the borrower can return assets equivalent either to the original asset or to a specific identical asset at the end of the loan. In some cases, bearer ecuritie may be used to aid tax evasion, and thus can sometimes be viewed negatively by issuers, shareholders and fiscal regulatory bodies alike. They are therefore rare in the United States.

lab3/inlab/lab3_160050049_160050108_160050009/Problem5/testcase/output5

+alike
+also
+alternative
+ame
+aMMA
+antimalware
+anywhere
+are
+arrive
+ave
+ecuritie
+entire
+entitle
+Europe
+example
+exchange
+eye
+image
+influence
+intimidati
+into
+issue
+Ive
+Once
+one
+online
+onto
+universe
+utilize

lab3/inlab/lab3_160050049_160050108_160050009/Problem6/script6.sh

+#!/bin/bash
+
+#split word-wise and lowercase
+while read line || [[ -n "$line" ]]
+do
+	for word in $line
+	do
+		echo $word | awk '{print tolower($0)}'
+	done
+done < "$1" > temp
+
+#remove punctuations
+#awk -F'[[:punct:]]' '{print $1}' temp1 > temp2
+sed -i 's/^[[:punct:]]*//' temp
+sed -i 's/[[:punct:]]*$//' temp
+
+#sort
+sort temp > temp1
+rm temp
+
+#remove repetitions
+prevword=""
+while read line || [[ -n "$line" ]]
+do
+	if [[ $line == $prevword ]]
+		then
+		prevword=$line
+	else
+		echo $line
+		prevword=$line
+	fi
+done < temp1
+rm temp1
\ No newline at end of file

lab3/inlab/lab3_160050049_160050108_160050009/Problem6/test.sh

+./script6.sh testcase/input6 > out
+
+diff testcase/output6 out > result
+
+if [[ -s result ]];
+then
+	echo failed
+else
+	echo passed
+fi
+rm out result

lab3/inlab/lab3_160050049_160050108_160050009/Problem6/testcase/input6

+We are the sum of experiences that we encounter as we go through life. 
+Day to day struggles and triumphs are experienced by all of the worlds creatures. 
+As human beings, when we encounter a challenge, we have freedom to choose how to react. 
+Every decision that we make leads us down a different road. We will never come to exactly the same crossroads. 
+Every decision that we make has significance. The tiniest choice that we make reverberates throughout the entire universe.
+I sleep in the clouds, dream in the sky,
+Ill keep dreaming as life passes me by,
+I think my dreams keep me sane,
+I dream of happiness, a life without pain,
+some people say Im stuck in this place,
+and Ill never go anywhere,
+but in my dreams Ive already been there,
+I know some day Ill have to wake up,
+but I feel the real world is more like a nightmare,
+Im safe in my closed eye wonderland,
+this poem goes to all the dreamers that understand,
+no matter what they say...
+keep your dreams but dont dream your life away,
+
+Electoral systems are the detailed constitutional arrangements and voting systems that convert the vote into a political decision. The first step is to tally the votes, for which various vote counting systems and ballot types are used. Voting systems then determine the result on the basis of the tally. Most systems can be categorized as either proportional or majoritarian
+
+When elections are called, politicians and their supporters attempt to influence policy by competing directly for the votes of constituents in what are called campaigns. Supporters for a campaign can be either formally organized or loosely affiliated, and frequently utilize campaign advertising. It is common for political scientists to attempt to predict elections via Political Forecasting methods
+
+Ransomware is a type of malware that prevents or limits users aMMA from accessing their system, either by locking the system's screen or by locking the users' files unless a ransom is paid. More modern ransomware families, collectively categorized as crypto-ransomware, encrypt certain file types on infected systems and forces users to pay the ransom through certain online payment methods to get a decrypt key.
+Ransom prices vary depending on the ransomware variant and the price or exchange rates of digital currencies. Thanks to the perceived anonymity offered by cryptocurrencies, ransomware operators commonly specify ransom payments in bitcoins. Recent ransomware variants ave also listed alternative payment options such as iTunes and Amazon gift cards. It should be noted, however, that paying the ransom does not guarantee that users will get the decryption key or unlock tool required to regain access to the infected system or hostaged files.
+Users may encounter this threat through a variety of means. Ransomware can be downloaded onto systems when unwitting users visit malicious or compromised websites. It can also arrive as a payload either dropped or downloaded by other malware. Some ransomware are known to be delivered as attachments from spammed email, downloaded from malicious pages through malvertisements, or dropped by exploit kits onto vulnerable systems.
+
+Once executed in the system, ransomware can either lock the computer screen, or, in the case of crypto-ransomware, encrypt predetermined files. In the first scenario, a full-screen image or notification is displayed on the infected system's screen, which prevents victims from using their system. This also shows the instructions on how users can pay for the ransom. The second type of ransomware prevents access to files to potentially critical or valuable files like documents and spreadsheets.
+
+Ransomware is considered scareware as it forces users to pay a fee or ransom by scaring or intimidati them. In this sense, it is similar to FAKEAV malware, but instead of capturing the infected system or encrypting files, FAKEAV shows fake antimalware scanning results to coax users into purchasing bogus antimalware software.
+
+But this massive wave wasn’t the only one. A few weeks later, a ransomware strain resembling Petya started spreading around Europe, affecting companies, Ukrainian institutions and banks, and even the even the radiation monitoring system at Chernobyl.
+
+Ransomware has been a growing trend for the past two years, and this is just a culmination, a grand reveal to the wider world of just how big of a threat it is. But we’ve been writing about this for a while now.
+
+The entity that creates the securities for sale is known as the issuer, and those that buy them are, of course, investors. Generally, securities represent an investment and a means by which municipalities, companies and other commercial enterprises can raise new capital. Companies can generate a lot of money when they go public, selling stock in an initial public offering, for example. City, state or county governments can raise funds for a particular project by floating a municipal bond issue. Depending on an institutions market demand or pricing structure, raising capital through securities can be a preferred alternative to financing through a bank loan.
+
+Bearer securities are those that are negotiable and entitle the shareholder to the rights under the security. They are transferred from investor to investor, in certain cases by endorsement and delivery. In terms of proprietary nature, pre-electronic bearer securities were always divided, meaning each security constituted a separate asset, legally distinct from others in the ame issue. Depending on market practice, divided security assets can be fungible or less commonly non-fungible, meaning that upon lending, the borrower can return assets equivalent either to the original asset or to a specific identical asset at the end of the loan. In some cases, bearer ecuritie may be used to aid tax evasion, and thus can sometimes be viewed negatively by issuers, shareholders and fiscal regulatory bodies alike. They are therefore rare in the United States.

lab3/inlab/lab3_160050049_160050108_160050009/Problem6/testcase/output6

+a
+about
+access
+accessing
+advertising
+affecting
+affiliated
+aid
+alike
+all
+already
+also
+alternative
+always
+amazon
+ame
+amma
+an
+and
+anonymity
+antimalware
+anywhere
+are
+around
+arrangements
+arrive
+as
+asset
+assets
+at
+attachments
+attempt
+ave
+away
+ballot
+bank
+banks
+basis
+be
+bearer
+been
+beings
+big
+bitcoins
+bodies
+bogus
+bond
+borrower
+but
+buy
+by
+called
+campaign
+campaigns
+can
+capital
+capturing
+cards
+case
+cases
+categorized
+certain
+challenge
+chernobyl
+choice
+choose
+city
+closed
+clouds
+coax
+collectively
+come
+commercial
+common
+commonly
+companies
+competing
+compromised
+computer
+considered
+constituents
+constituted
+constitutional
+convert
+counting
+county
+course
+creates
+creatures
+critical
+crossroads
+cryptocurrencies
+cryptoransomware
+culmination
+currencies
+day
+decision
+decrypt
+decryption
+delivered
+delivery
+demand
+depending
+detailed
+determine
+different
+digital
+directly
+displayed
+distinct
+divided
+documents
+does
+dont
+down
+downloaded
+dream
+dreamers
+dreaming
+dreams
+dropped
+each
+ecuritie
+either
+elections
+electoral
+email
+encounter
+encrypt
+encrypting
+end
+endorsement
+enterprises
+entire
+entitle
+entity
+equivalent
+europe
+evasion
+even
+every
+exactly
+example
+exchange
+executed
+experienced
+experiences
+exploit
+eye
+fake
+fakeav
+families
+fee
+feel
+few
+file
+files
+financing
+first
+fiscal
+floating
+for
+forces
+forecasting
+formally
+freedom
+frequently
+from
+fullscreen
+funds
+fungible
+generally
+generate
+get
+gift
+go
+goes
+governments
+grand
+growing
+guarantee
+happiness
+has
+have
+hostaged
+how
+however
+human
+i
+identical
+ill
+im
+image
+in
+infected
+influence
+initial
+instead
+institutions
+instructions
+intimidati
+into
+investment
+investor
+investors
+is
+issue
+issuer
+issuers
+it
+itunes
+ive
+just
+keep
+key
+kits
+know
+known
+later
+leads
+legally
+lending
+less
+life
+like
+limits
+listed
+loan
+lock
+locking
+loosely
+lot
+majoritarian
+make
+malicious
+malvertisements
+malware
+market
+massive
+matter
+may
+me
+meaning
+means
+methods
+modern
+money
+monitoring
+more
+most
+municipal
+municipalities
+my
+nature
+negatively
+negotiable
+never
+new
+nightmare
+no
+nonfungible
+not
+noted
+notification
+now
+of
+offered
+offering
+on
+once
+one
+online
+only
+onto
+operators
+options
+or
+organized
+original
+other
+others
+pages
+paid
+pain
+particular
+passes
+past
+pay
+paying
+payload
+payment
+payments
+people
+perceived
+petya
+place
+poem
+policy
+political
+politicians
+potentially
+practice
+predetermined
+predict
+preelectronic
+preferred
+prevents
+price
+prices
+pricing
+project
+proportional
+proprietary
+public
+purchasing
+radiation
+raise
+raising
+ransom
+ransomware
+rare
+rates
+react
+real
+recent
+regain
+regulatory
+represent
+required
+resembling
+result
+results
+return
+reveal
+reverberates
+rights
+road
+safe
+sale
+same
+sane
+say
+scanning
+scareware
+scaring
+scenario
+scientists
+screen
+second
+securities
+security
+selling
+sense
+separate
+shareholder
+shareholders
+should
+shows
+significance
+similar
+sky
+sleep
+software
+some
+sometimes
+spammed
+specific
+specify
+spreading
+spreadsheets
+started
+state
+states
+step
+stock
+strain
+structure
+struggles
+stuck
+such
+sum
+supporters
+system
+systems
+system's
+tally
+tax
+terms
+thanks
+that
+the
+their
+them
+then
+there
+therefore
+they
+think
+this
+those
+threat
+through
+throughout
+thus
+tiniest
+to
+tool
+transferred
+trend
+triumphs
+two
+type
+types
+ukrainian
+under
+understand
+united
+universe
+unless
+unlock
+unwitting
+up
+upon
+us
+used
+users
+users'
+using
+utilize
+valuable
+variant
+variants
+variety
+various
+vary
+via
+victims
+viewed
+visit
+vote
+votes
+voting
+vulnerable
+wake
+wasn’t
+wave
+we
+websites
+weeks
+were
+we’ve
+what
+when
+which
+while
+wider
+will
+without
+wonderland
+world
+worlds
+writing
+years
+your

lab3/inlab/lab3_160050049_160050108_160050009/readme.txt

+Marauders
+
+Pledge: "We've not given or received unauthorized assistance on this task"
+
+
+Members:
+sgtote - 160050009 : contributed in 
+maitrey - 160050049 : contributed in
+bhaveshd - 160050108 : contributed in
+
+
+Citations:
+
+https://stackoverflow.com/questions/21112707/check-if-a-string-matches-a-regex-in-bash-script
+
+https://stackoverflow.com/questions/2264428/converting-string-to-lower-case-in-bash
+
+https://stackoverflow.com/questions/42108365/removing-punctuation-and-tabs-with-sed
+
+https://stackoverflow.com/questions/12204192/awk-multiple-delimiter
+
+https://unix.stackexchange.com/questions/277089/grep-all-strings-that-start-with-a-certain-char-and-finish-with-another-char
+
+https://ss64.com/bash/grep.html
+

lab3/outlab/ProblemStatementOutLab3.txt

+Advanced SED and AWK Problem Statement
+*******************************************************************************************************
+------------------------------------------------------
+Solving Instructions for outlab assignment
+------------------------------------------------------
+
+Strictly follow the instructions given below:
+
+1. Solution for each assignment is to be typed into the .sh or .sed or .awk file already kept inside the corresponding folder.  
+
+2.  Remember, you need to  change the permission of the .sh file before executing it: 
+    ​   chmod u+x     ​ <scriptfile>  or chmod 777 <scriptfile>
+
+3. Do not change the structure and the names.. The automatic checker will give you a 
+“not­submitted” grade otherwise, if it does not find the names. 
+ 
+4. Remember to follow the exact output formats specified. Extra characters will lead to incorrect evaluation by automatic checker. 
+
+5. See the sample_input and sample_output for actual folder which is given in testcase directory of each problem. 
+
+5. Inside the script if you use any temporary file, write command to remove it after the 
+operation within that script only. 
+
+6. To check your solution run the script test.sh given in corresponding folder.
+
+-----------------------------------------------------------
+Submission Guidelines for assignment - (5 marks, 0 to be awarded in case these are not followed)[to be followed for both inlab and outlab]
+-----------------------------------------------------------
+1. Create a file readme.txt  in lab#rollno.1_rollno.2_rollno.3_rollno.4 directory, which contains contribution of each team member and references (cite where you get code/code snippets from).
+
+2. Rename the directory lab#rollno.1_rollno.2_rollno.3_rollno.4 to actual lab number instead of #, replace the rollno.N with your respective roll numbers.
+
+3. Compress the directory to <team_name>.tar.gz
+
+4. Submit one assignment per team. 	
+
+*******************************************************************************************************
+
+Out Lab Assignment
+
+-------------------------------------
+Problem 1:
+-------------------------------------
+
+You are leading the organization of IPL this year and have been provided with the Played-Win-Loss tally of all the teams.
+
+Given input file has 4 fields. There are field titles and then data in each column.
+
+In our case, the input file has fields to represent team names, no of
+matches played, no of wins, tied matches. You have to calculate points scored by every teams and place it in the fourth column titled "Points".
+
+4 points for win, 0 for loss and 2 for tie.
+
+Write a script to generate and print the output on screen.
+
+for example, if the input is
+
+Team	Played	Wins	Tied 
+A	2	1	1
+B	2	0	1
+
+then the output is 
+
+Team	Played	Wins	Tied	Points
+A	2	1	1	6	
+B	2	0	1	2
+
+The table is tab separated for both input and output.
+
+How to execute:
+./script1.sh <inputFileName>
+(here filename is passed as an ARGUMENT and NOT AS AN INPUT STREAM)
+
+
+
+-------------------------------------
+Problem 2:
+-------------------------------------
+
+Your input file contains text along with new line characters and white spaces. You should write a  script that will collapse every sequence of multiple white-space characters between two words in a single line into a single space. 
+Your script should also collapse every sequence of blank lines (multiple white spaces between two lines) into a single new-line character.
+Prefix and suffix whitespace characters must be removed. 
+You should print your output on the terminal
+
+
+Example: If the input is as follows:
+
+"    how  	are		you
+    
+    	
+    fine.    	
+    
+"
+    
+The output should look as follows:
+    
+"how are you
+fine."
+
+How to execute:
+./script2.sh <inputFileName>
+(here filename is passed as an ARGUMENT and NOT AS AN INPUT STREAM)
+
+
+
+
+-------------------------------------
+Problem 3:
+-------------------------------------
+
+How about a simple challenge! Do you know about a tool called ‘wc’? It helps you count the no. of lines, no. of words, characters and even bytes of a text file.
+
+Can you design your own version of ‘wc’ without using ‘wc’ itself? Let us trivialize the problem a little. Write a bash script to take a filename as an input argument and calculate the no. of line, no. of words, and no. of characters. Your script should also be able to take flags which are optional and should be able to print simply the no. of line if the line flag is given as an argument. At minimum, the flags should be:
+
+-lines = when this is provided to the script along with the input file, the script should ONLY print the no. of lines in the file.
+
+-words = when this is provided to the script along with the input file, the script should ONLY print the no. of words in the file.
+
+-chars = when this is provided to the script along with the input file, the script should ONLY print the no. of characters in the file (you must ignore the whitespaces) and count other characters.
+
+-paras = when this is provided to the script along with the input file, the script should ONLY print the no. of paragraphs in the file (you can count a blank line as a separation between two paragraphs - simple!) and count other characters.
+
+For e.g.: 
+
+    How are   	you
+  I am fine
+  Thank you!
+    
+  How   are you?
+
+
+output:
+35 characters, 11 words, 12 lines, 2 paragraphs
+
+The above should be the output when nothing is provided as a flags to the script, but in case a flag is provided you script must only print the value for the flag provided.
+
+For e.g.:  >>./script3.sh <file> -para
+
+>>2 paragraphs
+
+-------------------------------------
+Problem 4:
+-------------------------------------
+
+Let’s deal with a real life problem now. You have dealt with enough imaginary scenarios. We have a list of Name, Addresses, and E-mail ID’s in a PDF file. We use Optical character recognition to bring it to DOC/DOCX and then TXT. You will find the TXT file in the folder for “script5”. If you look at the file carefully, you will notice that there is a pattern to the records maintained in it. Line 1 is usually a name, Line 2 onwards you have address, unless you encounter E-mail ID and then the last line has e-mail ID. There are some blank lines here and there, of course, you would be able to identify and clean them up. The challenge here is to be able to create a CSV file out of this. A file which has column headings:
+Name||Address||EmailID
+
+and later every row entailing the heading is a record and the data is stored in the respective columns.
+
+The task at hand:
+
+Take the input text file as an argument to your script. Make sure you take into account whitespaces, newlines, blank lines, here and there and eventually produce the output as described above.
+
+
+
+
+
+
+
+-------------------------------------
+Problem 5:
+-------------------------------------
+
+National Survey Association has hired you for the post of Associate Data Analyzer. As part of training programme, they have given you the following assignment. The assignment is pretty simple and is as follows: 
+
+You will be given a .csv file as an argument. It contains ‘Name’, ‘City’ and ‘Salary’ fields. You have to write an AWK script that will sum the salary of all the people working in a city and output the total salary grouped and sorted by city. By sorted we mean an alphabetical sort on the city names.
+
+Note: The input file will contain records separated by ‘,’ (comma)
+(You must print the output on the terminal)
+
+For example:
+Ram,Mumbai,200
+Shyam,Mumbai,500
+David,Delhi,300
+
+Output should be:
+Mumbai,700
+Delhi,300	
+
+How to execute:
+awk -f <fileName> <inputFileName>
+
+-------------------------------------
+Problem 6:
+-------------------------------------
+
+Have you heard of Natural Language Processing (NLP) / Artificial Intelligence? NLP is quite heavily done at Google, FB, MS and many other organizations and startups. Did you know that in your in-lab problem 6 you have already dealt with a minor NLP related problem where you created a dictionary. Here is an extension of what you did. C’mon, why wouldn’t you smile!? Half of the problem you have probably already solved (well, if you did not, consider this a way of forcing you to do so! :P).  You created a dictionary from a text file in problem 6. What we would like you to do now is to calculate TF i.e. Term Frequency for all the unique words in the given set of documents. 
+
+Go here, if you need to know more:
+https://en.wikipedia.org/wiki/Tf-idf
+(just look at the TF part, IDF requires one to calculate the log of values which is not easily available in bash and we are not expecting you to code it up, so just TF would be good).
+
+Term frequency is calculated using the count of words (unique words in the document, make sure you do not count similar or same word twice due to punctuation etc. We have clarified all such things in problem 6 in the inlab).
+
+The word dictionary you created now gets extended to a file where you also get the count of each word which occurs in the document. This count can be used to calculate the TF. Please do check out other references from the web as well, which may help you with this.
+
+We provide you with three documents:
+<input1> <input2> <input3>
+
+Your script must be able to take as input 3 arguments of these documents and should be able to calculate TF for all the unique set of words in the documents/input files.
+
+Output:
+The output should printed on the terminal and not stored in a file. Please be wary of this. I really do not want to repeat… idiosyncracies..deduction of marks..
+
+Thanks! May the Bash be with you!
+
+

lab3/outlab/lab3_160050049_160050108_160050009/Problem1/script1.sh

+#!/bin/bash
+
+cat $1 | awk 'BEGIN {FS="\t"; OFS=""; print "Team\tPlayed\tWins\tTied\tPoints"}
+{if (NR>1)
+	print $1,"\t",$2,"\t",$3,"\t",$4,"\t",$3*4+$4*2}'

lab3/outlab/lab3_160050049_160050108_160050009/Problem1/test

+Team	Played	Wins	Tied 
+A	2	1	1
+B	2	0	1

lab3/outlab/lab3_160050049_160050108_160050009/Problem2/script2.sh

+#!/bin/bash
+count=0
+now=0
+grep -v -e '^[[:space:]]*$' $1 |
+sed -e 's/[[:space:]][[:space:]]*/\ /g' |
+sed -e 's/^[[:space:]]*//' |
+sed -e 's/[[:space:]]*$//' |
+sed -e 's/[[:space:]]*[!]/!/g' |
+sed -e 's/[[:space:]]*[:]/:/g' |
+sed -e 's/[[:space:]]*[;]/;/g' |
+sed -e 's/[[:space:]]*[,]/,/g' |
+sed -e 's/[[:space:]]*[.]/./g' |
+sed -e 's/[[:space:]]*[?]/?/g' |
+sed -e 's/[[:space:]]*[)]/)/g' |
+sed -e 's/[(][[:space:]]*/(/g' > temp
+
+count=$(cat temp | grep -o \" | wc -l)
+
+for (( i = 1; i <= $count; i++ ))
+do
+	#echo "l"
+	if [[ $((i%2)) == $((count%2)) ]]
+		then
+		#echo "p"
+		sed -i '0,/" /s//~/' temp
+	fi
+	if [[ $((i%2)) != $((count%2)) ]]
+		then
+		#echo "q"
+		sed -i '0,/ "/s//~/' temp
+	fi
+done
+
+sed 's/~/"/g' temp
+
+rm temp

lab3/outlab/lab3_160050049_160050108_160050009/Problem3/script3.sh

+#!/bin/bash
+
+
+if [ "$2" == "-lines" ] 
+	then awk 'END {print NR" lines"}' $1
+elif [ "$2" == "-words" ]
+	then awk '{w=w+NF;} END {print w" words"}' $1
+elif [ "$2" == "-chars" ]
+	then sed -e s/" *"/""/g -e s/":a;N;$!ba;"/""/g -e s/"	*"/""/g $1 | awk '{c = c+length($0);}END {print c" characters"}'
+elif [ "$2" == "-paras" ]
+	then awk 'BEGIN {p=1} {if (length($0)==0 && prev!=0) p=p+1;prev=length($0)} END {{if ($0 == "") p=p-1} {print p" paragraphs"}}' $1
+elif [ "$2" == "" ]
+	then sed -e s/" *"/""/g -e s/":a;N;$!ba;"/""/g -e s/"	*"/""/g $1 | awk '{c = c+length($0);}END {print c" characters"}' >> output
+		 awk '{w = w+NF;}END {print w" words"}' $1 >> output
+		 awk 'END {print NR" lines"}' $1 >> output
+		 awk 'BEGIN {p=1} {if (length($0)==0 && prev!=0) p=p+1;prev=length($0)} END {{if ($0 == "") p=p-1} {print p" paragraphs"}}' $1 >> output
+		 sed ':a;N;$!ba;s/\n/, /g' output
+		 rm output
+fi
+
+#https://codegolf.stackexchange.com/questions/74222/reimplement-the-wc-coreutil?noredirect=1&lq=1
\ No newline at end of file

lab3/outlab/lab3_160050049_160050108_160050009/Problem4/.!35984!temp

+
+Mns. Manju Bhabha
+Manine Castle

lab3/outlab/lab3_160050049_160050108_160050009/Problem4/problem4InputFile.txt

+
+Mrs. Manju Bhabha
+Marine Castle
+D Road
+Marine Drive
+Mumbai  400020
+Email. Id:
Mrs. M.K. Byconji
+128, Khetan House
+311 Jamshedji Tata road
+Churchgate 
+Mumbai 400020
+Email Id : bymk@gmail.com
C. Vishnudas 
+A-11, Bund Garden
+North Main Road
+Koregaon Park
+Pune  411011
+Email Id :
Mr. K. Subhas Chandiramani
+603, Regalia
+Shiv Vallabh Road,
+Borivali (East)
+Mumbai 400066
+Email Id :
Mr. Vijay Chaurasia
+4th Floor, Wadia Bld.,
+127, M.G. Road,
+Fort, Mumbai 400001
+Email Id :
+Aparna Chaiwala
+Victory Apartments,
+Dahanukar Marg,
+Mumbai 400026
+Email Id :
Mr. Pervez S. Chaddha
+Hill View
+23, Hughes Road,
+Kemps Corner
+Mumbai  400007
+Email Id :
Manish Chaddha
+fake house no., fake street,
+mumbai - 76
+Email Id : chaddha@yahoo.co.in
Mr. Sanjeev Chedda
+M/s. Syntel (India) Ltd.
+Unit No. 112
+SEEPZ, Andheri (E), Mumbai  400096
+Email Id :
Viraf N. Agha
+7, Casio Bldg. 
+Tardeo, Mumbai  400034
+Email Id :
+
+Mr. Hari N. Cheliya
+B-54, Anitha Colony
+Bajaj Nagar, Jaipur  302020
+Email Id :
+S. Chauhan
+211 Vanity Towers,
+P. Balu Marg,
+Mumbai  400025
+Email Id : s.chauhan@gmail.com
+
+Mr. & Mrs. J.C. Chavan
+Reville,
+45, Cuffe Parade,
+Mumbai  400004
+Email Id :
Mr. B.P. Choudhury
+41/42 Atlanta
+Nariman Point
+Mumbai  400021
+Email Id :
Mrs. Shukla C
+1203, Eldora,
+Hiranandani Gardens,
+Powai, Mumbai  400076
+Email Id :
Mrs. Anuradha Chand
+Sunny House
+Sunny Road,
+Mumbai  400026
+Email Id :
Mr. E. M. Chudasama
+16, Banga-E- Sahara
+Nepean Sea Road
+Mumbai 400006
+Email Id :
Mr. & Mrs. Nana Chand
+2, Swapna Mahal
+143, Gangopadhyaya Road, 
+Mumbai  400020
+Email Id :
Fraunak Ramji
+554, Hassa Mahal,
+Dalamal Park
+Cuffe Parade
+Mumbai 400005
+Email Id :
Ms. Anju Pankaj
+New Friends Colony,
+Behind Babulnath Temple
+Mumbai  400007
+Email Id :
Mr. Halim Pir
+55, Bank Street 
+Mumbai 400023
+Email Id :
Mr. & Mrs. G.K. Andheriwala
+Daisy Castle
+Mount Pleasant Road,
+Mumbai 400006
+Email Id :
Ms. Nani & Diggi Coulose
+Sigma House
+Wadala, Mumbai 400031
+Email Id :
Priya Bankim
+Sea Wood Apts.,
+Lokhandwala Complex, 
+Andheri (w), Mumbai 400053
+Email Id :

lab3/outlab/lab3_160050049_160050108_160050009/Problem4/script4.sh

+#!/bin/bash
+
+Cond=1
+text=""
+default=""
+cat $1 > temp
+sed -i -e "s/\r/\n/g" temp
+cat temp | sed '/^\s*$/d' |
+while read line
+do
+	if [[ $line = \Email* ]]
+		then
+		echo "~"
+		for word in $line
+    	do
+        	if [[ "$word" == *"@"* ]]
+        		then
+		       	email="$word"
+		       	break
+        	fi
+        	if [[ "$word" != *"@"* ]]
+        		then
+        		email="$default"
+        	fi
+    	done
+    	echo $email
+    	Cond=1
+    	echo "~~~"
+		continue
+	fi
+    if [[ $Cond == 1 ]]
+       	then
+       	echo $line
+       	echo "~"
+       	Cond=0
+       	continue
+    fi
+    if [[ $Cond != 1 ]]
+      	then
+      	 	echo $line
+      	 	continue
+    fi
+done | awk 'BEGIN {RS="~~~"; ORS="###"} {print $0}' |
+awk 'BEGIN {RS="~"; ORS="||"} {print $0}' > output.txt
+echo >> output.txt
+cat output.txt |
+while read line
+do
+	text="$text $line"
+	echo $text | awk 'BEGIN {RS="###"}{print $0}' | sed '/^\s*$/d' | sed 's/^ *//' > output.csv
+done
+sed -i '$d' output.csv
+
+rm output.txt
+rm temp 

lab3/outlab/lab3_160050049_160050108_160050009/Problem5/script5.awk

+#BEGIN {"sort -t, -k2 "} {FS=","} { if ($2==prev) {a=a+$3; } 
+#						else { if (prev) { print prev","a; };
+#							      prev=$2; a=$3; }}
+#	END { if (prev) { print prev "," a;}}
+
+BEGIN {FS=","} {a[$2]+=$3;}END{for(i in a)print i", "a[i] | "sort";}
+
+#https://stackoverflow.com/questions/7502459/check-variables-from-different-lines-with-awk 
+#http://www.theunixschool.com/2012/06/awk-10-examples-to-group-data-in-csv-or.html
\ No newline at end of file

lab3/outlab/lab3_160050049_160050108_160050009/Problem6/script6.sh

+#!/bin/bash
+
+#split word-wise and lowercase file 1
+while read line || [[ -n "$line" ]]
+do
+	for word in $line
+	do
+		echo $word | tr "\200-\377" "\000-\177" | awk '{print tolower($0)}'
+	done
+done < "$1" > temp
+
+#split word-wise and lowercase file 2
+while read line || [[ -n "$line" ]]
+do
+	for word in $line
+	do
+		echo $word | tr "\200-\377" "\000-\177" | awk '{print tolower($0)}'
+	done
+done < "$2" >> temp
+
+#split word-wise and lowercase file 3
+while read line || [[ -n "$line" ]]
+do
+	for word in $line
+	do
+		echo $word | tr "\200-\377" "\000-\177" | awk '{print tolower($0)}'
+	done
+done < "$3" >> temp
+
+#remove punctuations
+sed -e 's/^[[:punct:]][[:punct:]]*//g' temp | 
+sed -e 's/[[:punct:]][[:punct:]]*$//g' | 
+sed -e 's/[,\.!?;]*//g' |
+grep -v -e '^[[:space:]]*$' |
+
+#sort
+sort > temp1
+rm temp 
+sed -i 's/^/\ /g' temp1
+sed -i 's/$/\ /g' temp1
+sed -i 's/\r//g' temp1
+
+TOTALCOUNT=$(wc -l < temp1)
+
+
+#remove repetitions
+prevword=NULL
+while read line || [[ -n "$line" ]]
+do
+	if [[ $line == $prevword ]]
+		then
+		prevword=$line
+	else
+		count=$(grep -c " $prevword " temp1)
+		fraction="$count/$TOTALCOUNT"
+		fractionprint=$(echo $fraction | bc -l)
+		echo $prevword,$fractionprint
+		prevword=$line
+	fi
+done < temp1 > temp2
+count=$(grep -c " $prevword " temp1)
+fraction="$count/$TOTALCOUNT"
+fractionprint=$(echo $fraction | bc -l)
+echo "$prevword,$fractionprint" >> temp2
+
+
+tail -n +2 temp2
\ No newline at end of file

lab3/outlab/lab3_160050049_160050108_160050009/readme.txt

+Marauders
+
+Pledge: "We've not given or received unauthorized assistance on this task"
+
+
+Members:
+sgtote - 160050009 : contributed in 3,5,6
+maitrey - 160050049 : contributed in 1,4
+bhaveshd - 160050108 : contributed in 2,6
+
+
+Citations:
+
+https://codegolf.stackexchange.com/questions/74222/reimplement-the-wc-coreutil?noredirect=1&lq=1
+
+https://stackoverflow.com/questions/7502459/check-variables-from-different-lines-with-awk 
+
+http://www.real-world-systems.com/docs/tr.1.html
+
+http://www.theunixschool.com/2012/06/awk-10-examples-to-group-data-in-csv-or.html
+
+http://www.thegeekstuff.com/2010/02/awk-conditional-statements/
+
+https://stackoverflow.com/questions/24737309/awk-skip-header-add-columns
+
+https://stackoverflow.com/questions/16414410/delete-empty-lines-using-sed
+
+https://stackoverflow.com/questions/29473520/removing-m-from-a-csv-file
+
+https://stackoverflow.com/questions/4881930/remove-the-last-line-from-a-file-in-bash
+
+https://stackoverflow.com/questions/148451/how-to-use-sed-to-replace-only-the-first-occurrence-in-a-file
+
+https://stackoverflow.com/questions/15015809/floating-point-results-in-bash-integer-division