Joining files with PowerShell

Posted On 2016-12-21 by dwirch
Tags: Powershell Scripting Tip Windows
Views: 257

As a server administrator, one of my duties is to review log files for anomolous behavior, errors, or other issues. For me, combining all the daily logs into one big file is much easier to review.

Yes, I do daily reviews of the logs, which is a tedious job in itself. My monthly task involves combining all the daily logs for the month into one file, then ingesting the data into a spreadsheet. From there, I can make all kinds of pretty graphs, charts, and tables which reflects traffic trends over the month.

But the first step is compiling the data for easy ingestion into my spreadsheet. I use a Windows-based web host, so it uses Internet Information Services (IIS). IIS is configured to create daily log files. Importing each log file into a spreadsheet is tedious.

I used the following PowerShell script to combine all the log files into one handy file:

$OutputFile=$WorkPath + "JoinedFile.log"

$LogFiles=get-childitem -Filter *.log -Path $WorkPath

ForEach($LogFile in $LogFiles)
   Get-Content $CurrentFile | Out-File -append $OutputFile -Encoding ascii


What it does:

The first two lines simply set a couple of default values, one for the location of the files ($WorkPath), and one for the name of the output file ($OutputFile).

Next, a list of the files is gathered up into $LogFiles. For this exercise, we are only interested in files with the .log extension, so it is specified in the Filter switch.

Inside the ForEach loop, the full name of the current file is acquired ($CurrentFile), and then displayed on screen. It's always good to have an indication of progress visible, so the user can see what is going on.

The last line of the loop grabs the content of $CurrentFile, and pipes it out to $OutputFile, in append mode.

Simple, straightforward, and quick. Got a better way? Show us in the comments, or in the forums.

About the Author

dwirch has posted a total of 172 articles.


Comments On This Post

No comments on this post yet!

Do you have a thought relating to this post? You can post your comment here. If you have an unrelated question, you can use the Q&A section to ask it.

Or you can drop a note to the administrators if you're not sure where you should post.

Your IP address is:

Before you can post, you need to prove you are human. If you log in, this test goes away.

Recent Forum Posts

Job Spammer: Sathya Narayana
dwirch posted on March 15, 2017 at about 7:18 in Spammers

Job Spammer: Manish Kumar
dwirch posted on March 14, 2017 at about 17:44 in Spammers

Site Migration Complete
dwirch posted on March 12, 2017 at about 11:10 in Site News

Site Migration Complete
dwirch posted on March 11, 2017 at about 0:35 in Site News

Job Spammer: Jason Weinstein
dwirch posted on March 10, 2017 at about 14:00 in Spammers

Job Spammer: Ryan Wilson
dwirch posted on March 8, 2017 at about 17:00 in Spammers