Git Product home page Git Product logo

ftpsync2d's Introduction

  • I'm currently a Staff Software Engineer at Quansight

  • My current interests in Scientific Computing include (see here for technical blogs):

    • Validation of mathematical functions with complex inputs in various libraries such as NumPy, PyTorch, XLA/JAX, Tensorflow, MPMath, etc
    • Theory of Sparse Arrays, in particular, PyTorch sparse tensors support
    • Optimization of Triton kernel parameters
    • Interoperability of Array-like objects from various software
    • Algorithms and Implementations
    • Support Fortran 90 TYPE construct in F2Py
  • I have initiated and co-authored a number of open source projects with the following highlights:

    • RBC - Remote Backend Compiler
    • F2Py - Fortran to Python interface generator DOI, ships with NumPy DOI
    • SciPy - open-source software for mathematics, science, and engineering DOI

    and contributed to a number of open source projects such as XLA, JAX, Heavy.AI, PyTorch, Numba, Apache Arrow, conda-forge, XND, SymPy, etc.

  • My background is in Scientific Research: Mathematical Physics, Nonlinear Waves, Mechanics, Systems Biology, Microscopy, Solid Mechanics, Optics, Scientific Computations, etc. CV@ERIS, ORCID, Scholar

  • ๐Ÿ“ซ How to reach me: Linkedin, GMail

  • Fun facts:

    • I have completed AoC 2019, AoC 2020
    • Estonian Champion 2006 in Dog Obedience (German Shepherd), currently training for Agility (Boston Terrier)
    • Ship engineer by profession, raced with power boats (Circuit S-250, S-350, OSY-400, O-125, F-500), teached sailing to kids
  • ๐Ÿ˜„ Pronouns: standard Modern English

ftpsync2d's People

Contributors

kameecoding avatar pearu avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

ftpsync2d's Issues

Example

Hello,

your example "ftpsync.py ftp://ftp.example.com/rdir ldir --download" gives an 
assertion error.  I just cant work out in what format the login and folder 
details need to be put. Could you give an example with user name and password 
please.

Cheers

Original issue reported on code.google.com by [email protected] on 25 Oct 2011 at 11:38

Script doesn't account for '/'

listing directory '/temp/' <connecting to 178.63.32.185.. <creating directory '/temp'>Traceback (most recent call last): File "ftpsync2d/ftpsync.py", line 709, in <module> main() File "ftpsync2d/ftpsync.py", line 618, in main remote_files = session.get_files(update_listing=options.update_listing) File "ftpsync2d/ftpsync.py", line 322, in get_files for rfn, mtime in self.get_remote_files(update_listing=update_listing).items(): File "ftpsync2d/ftpsync.py", line 239, in get_remote_files lst = filter(lambda n: n not in ['.', '..'], self.ftp.nlst(wd)) File "ftpsync2d/ftpsync.py", line 131, in ftp self.clock_offset = self.clocksync() File "ftpsync2d/ftpsync.py", line 174, in clocksync self.makedirs(os.path.dirname(rfn)) File "ftpsync2d/ftpsync.py", line 378, in makedirs self.ftp.mkd(fullpath) File "/usr/lib/python2.7/ftplib.py", line 577, in mkd resp = self.sendcmd('MKD ' + dirname) File "/usr/lib/python2.7/ftplib.py", line 249, in sendcmd return self.getresp() File "/usr/lib/python2.7/ftplib.py", line 224, in getresp raise error_perm, resp ftplib.error_perm: 550 Create directory operation failed.

Here is lst printed out from line 371
['/Desktop', '/Downloads', '/acd', '/cleanup.sh', '/conv2mp4-py.py', '/download.sh', '/downlooad.sh', '/encfs.xml', '/ftpsync2d', '/home', '/launcher.sh', '/local', '/media', '/simple_convert.log', '/sync.sh', '/temp']

It failes because it tries to find 'temp' but the list only containst '/temp'

Creation of remote path on Windows

What steps will reproduce the problem?
1. be on Windows
2. start a synchronization

What is the expected output? What do you see instead?
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "disk\ftpsync.py", line 668, in main
    session = FtpSession(remote_path)
  File "disk\ftpsync.py", line 546, in __init__
    assert remote_path.startswith('/'),`remote_path`
AssertionError: '\\dirtosync'

What version of the product are you using? On what operating system?
Version 1.1-svn on Windows XP SP3

Please provide any additional information below.
I wrote here to try this feature of Google Code! :-)

Original issue reported on code.google.com by [email protected] on 5 Jan 2009 at 11:07

New option to remove files while uploading

Hi guys, thanks for this script! I'm using it and it's being really helpful in 
my project.
I just wanted to give you my own version in which I added an option to use for 
removing files at FTP which are no longer present on your local machine.
You need to use it with the --upload option to perform  deletions.
Just wanted to share with you in case it could help anybody else.
Barbara

Original issue reported on code.google.com by [email protected] on 30 Jan 2014 at 7:57

Attachments:

Problem uploading files with ":" in the filename

When I'm running the script to sync a folder with one or more filenames 
with colon in it.

For example: 
photos/album1:picture1.jpg
photos/album1:picture2.jpg
photos/album2:picture1.jpg

The script raises an exception saying that the a lambda function should 
receive 2 arguments but is receiving 3 instead.
It happens because there is a split(":") to get the file size for each one 
of the lines which break the filename in the middle.

This is happening in the version 1.0 but in a quick check in the SVN 
version seems to have the same problem.

The fix I'm using is replace the split by a rsplit with a limit of 1 as 
follow:

- return dict([func(*line.rsplit(':', 1)) for line in l.splitlines()])
+ return dict([func(*line.split(':')) for line in l.splitlines()])

Let me know if you need any further info.

Original issue reported on code.google.com by seocam on 23 Feb 2010 at 5:46

Launch client on Windows (Server is Linux)

Hi,

I had problems running the client on windows, so I have made some modifications 
to it. Mainly to handle the client side path separator correctly.

Check it and merge it if you want. There is no problems existing, so I only 
create this ticket to share the code for you.

Other: I plan to modify the whole function to be able to follow server side 
changes fluently. That means to store the .listing files locally and use the 
"MDTM" stuff only when the files are changed on both sides (conflicts). But 
those are bigger changes.

Brgds,
Viktor

Original issue reported on code.google.com by [email protected] on 26 Jun 2010 at 8:27

Attachments:

Working with FTPS (explicit FTP over TLS)

Not sure if an issue or a feature request ...

I've tried using FTPS:// instead of FTP:// but force adds an FTP:// in front so it's being recognized as the hostname.

I'm not seeing any TLS/SSL/FTPS reference in the code, so by any chance, will this be supporting FTPS ? Or a quick suggestion on how to add support for that?

Thx

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.