Comments (4)
martin9700
commented on August 20, 2024
Interesting, I look forward to your pull request! Could you include before and after times on a really big text file? Maybe 10,000 lines or something? I think that would be really interesting to see.
from get-contentfast.
martin9700
commented on August 20, 2024
Interesting read on MSDN (what I can make of it). It's all about being a reader, but then lower down mentions it can use the write method. Sheesh, make up your mind! :)
StreamReader is designed for character input in a particular encoding, whereas the Stream class is designed for byte input and output. Use StreamReader for reading lines of information from a standard text file.
The Read(Char[], Int32, Int32) and Write(Char[], Int32, Int32) method overloads read and write the number of characters specified by the count parameter. These are to be distinguished from BufferedStream.Read and BufferedStream.Write, which read and write the number of bytes specified by the count parameter. Use the BufferedStream methods only for reading and writing an integral number of byte array elements.
from get-contentfast.
johnanson
commented on August 20, 2024
Hi Martin
I downloaded Get-ContentFast, but had problems getting it to run.
So below are a few lines copied from your code that show the error you'll
get if you use get-ContentFast.ps1 on a file that is open for writing, like
the log file I tested with.
It takes less than 0.1s to read 200,000 lines from a file of 9.5MB
Regards, John
*Execution output:*
.\Get-ContentFastTest.ps1
$readOnly is False
New-Object : Exception calling ".ctor" with "1" argument(s): "The process
cannot access the file 'C:\Program Files
(x86)\StorageCraft\ImageManager\Logs\ftp[pmrrep.advantage.co.nz%gls1]-4.log'
because it is being used by another
process."
At C:\temp\Get-ContentFastTest.ps1:14 char:11
+ $File = New-Object System.IO.StreamReader -Argument $PathName
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : InvalidOperation: (:) [New-Object],
MethodInvocationException
+ FullyQualifiedErrorId :
ConstructorInvokedThrowException,Microsoft.PowerShell.Commands.NewObjectCommand
.\Get-ContentFastTest.ps1 -readonly
$readOnly is True
204686 lines read
Elapsed time: 00:00:00.0986366
*Get-ContentFastTest.ps1:*
param (
[switch] $readOnly
)
$startTime = get-date
$PathName = "C:\Program Files (x86)\StorageCraft\ImageManager\Logs\ftp[
pmrrep.advantage.co.nz%gls1]-4.log"
Write-Verbose "Reading $PathName..."
$fs = [IO.File]::Open($PathName, [IO.FileMode]::Open,
[IO.FileAccess]::Read, [IO.FileShare]::ReadWrite)
"`$readOnly is $readOnly"
if ( $readOnly) {
$File = New-Object System.IO.StreamReader -Argument $fs
} else {
$File = New-Object System.IO.StreamReader -Argument $PathName
}
$lineCount = 0
While (($Line = $File.ReadLine()) -ne $null) { # Need -ne $null in case
line equates to false (empty, "0", etc)
$lineCount++
}
"$lineCount lines read"
"Elapsed time: $((get-date)-$startTime)"
…On Tue, 14 May 2019 at 22:22, MartinPugh ***@***.***> wrote:
Interesting read on MSDN (what I can make of it). It's all about being a
reader, but then lower down mentions it can use the write method. Sheesh,
make up your mind! :)
StreamReader is designed for character input in a particular encoding, whereas the Stream class is designed for byte input and output. Use StreamReader for reading lines of information from a standard text file.
The Read(Char[], Int32, Int32) and Write(Char[], Int32, Int32) method overloads read and write the number of characters specified by the count parameter. These are to be distinguished from BufferedStream.Read and BufferedStream.Write, which read and write the number of bytes specified by the count parameter. Use the BufferedStream methods only for reading and writing an integral number of byte array elements.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#1?email_source=notifications&email_token=AF47FEJWMOGDCVWRB7NPRETPVKHIFA5CNFSM4HMUEQN2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODVLBB5I#issuecomment-492179701>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AF47FENELDCCA7J77PFDCVTPVKHIFANCNFSM4HMUEQNQ>
.
from get-contentfast.
martin9700
commented on August 20, 2024
Nice work. Do you know how contribute your code to the repository?
from get-contentfast.
Related Issues (1)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from get-contentfast.