[Discuss] SCP file size limitations

George Farris farrisg at shaw.ca
Thu Nov 23 17:02:50 PST 2006


On Thu, 2006-23-11 at 08:32 -0800, pw wrote:
> George Farris wrote:
> > On Wed, 2006-22-11 at 18:26 -0800, pw wrote:
> >> George Farris wrote:
> >>> On Wed, 2006-22-11 at 11:23 -0800, pw wrote:
> >>>
> >>>> Hello,
> >>>>
> >>>> Does anyone know if there is a file size limitation for
> >>>> SCP?
> >>>>
> >>>
> >>> Oops forgot to say with split you just cat the files back together.
> >>>
> >>> cat file1 file2 files3 > original
> >>>
> >>
> >> Except that the overhead becomes twice the size of the original file.
> > 
> > Eh?  What are you talking about?  Split will split a binary file into
> > binary pieces.  No bigger than the original.
> > 
> 
> If I have 2 files of 100GB and I cat them together on
> a machine. I then have 2 files of 100GB and one
> output file of 200GB. Twice as much as before.

Sorry not really following that:

I have a 100G file called data.dat, I use "split -b 50000m data.dat" to
split it into two files called xaa and xab, both 50G in size.  

I now scp each of the xa? files and then at the other end cat them back
together with "cat xaa xab > data.dat"  Delete both xaa and xab and I'm
left with the original 100G file.

I've deleted the thread so maybe I missed something, sorry if I did.


-- 
George Farris
farrisg at shaw.ca




More information about the Discuss mailing list