AMX Zip

Well I don't know how you would go about compressing files into a zipped folder while on the master but if you stick to straight FTP you can make a master list of file you want to check and periodiclally query those files to determine which files have been modified since the last transfer. This way once this query is complete you just build a file list of the files that have changed and thus need to be transfered.

I've done this on my desktop running the FileZilla server and query using the FTP MDTM command which returns the files date time stamp when it was last modified and compare that to the date time stamp I have on record in the master. Now I've only done this one way so I don't know if the master support this command. It seems all FTP servers have a slightly different lists of supported commands.

This might be a better option considering it may be impossible to zip from inside the master. You could probably do it w/ PHP but you'd be transfering the files to the PC to zip and then putting the file back on the master to transfer out and that makes no sense. At least if the master supports the MDTM command you can transfer just what's needed, normally, unzipped.

Joe Hebert wrote:

I suppose I could do a manual differential backup (and may end up just doing that) but I?d prefer to create a hands free operation if at all possible.

It wouldn't have to be manual. Just pick a time of day to run the MDTM command query (if it works on the master's ftp server) and create a list of the files that have been modified, then automatically do the transfer. I have code that does this but I query for files on a desktop every five minutes to look for changes, then depending flag state for "auto transfers" I will either automatically retrieved the modified files and parse them or just indicate that files have been modified and wait for a manual button push to initiate the transfers. I originally wrote this so I could have customers make notes on a PC, to do lists, kid's chores, etc and have the system automatically retireve the file and parse it for display on a TP. Kind of like a notepad. for up to 10 files but it could easily do 100s of files and just omit the parsing steps.

Well it apprears the master doesn't support the MDTM command anyway.

Microsoft Windows XP [Version 5.1.2600]
(C) Copyright 1985-2001 Microsoft Corp.

C:\Documents and Settings\VAV>ftp
ftp> o 192.168.1.60
Connected to 192.168.1.60.
220 VxWorks (VxWorks5.5.1) FTP server ready
User (192.168.1.60:(none)): vining
331 Password required
Password:
230 User logged in
ftp> ?
Commands may be abbreviated.  Commands are:

!               delete          literal         prompt          send
?               debug           ls              put             status
append          dir             mdelete         pwd             trace
ascii           disconnect      mdir            quit            type
bell            get             mget            quote           user
binary          glob            mkdir           recv            verbose
bye             hash            mls             remotehelp
cd              help            mput            rename
close           lcd             open            rmdir
ftp>

Since you are not compressing the files, you may also want to check the .tar format. I was looking at it briefly yesterday and it didn't seem very difficult to implement. I am pretty sure there are fewer options (which means a little less code), so it may be easier to code and still accomplish the same thing.

Jeff

Has anyone made any progress on this? Due to a catastrophic blunder on my part, I have a high motivation to make this happen. As a result, I whipped together the beginnings of a duet module that does this. So far, I have spent about 10 minutes writing code, 90 minutes figuring out how to tell java what I want it to do, and 1 hour playing with it on a master to figure out the intricacies of the netlinx master. The nice thing is: I have a module that WILL create a COMPRESSED zip file.

Here is all of the java code I had to write to make this happen:

	public void handleCommandEvent(Event obj, String cmd) {
		super.handleCommandEvent(obj, cmd);
		// Command syntax: ZIP-(\FolderToZip)-(NameOfZip.zip)
		if(cmd.startsWith("UNZIP<>")){
			System.out.println("UNZIP<> not yet implemented.");
		}else if(cmd.startsWith("ZIP<>")){
			System.out.println(cmd);
			StringBuffer zipMe = new StringBuffer(cmd);
			System.out.println(zipMe.toString());
			zipMe.delete(0,zipMe.indexOf("<>")+2);
			System.out.println(zipMe.toString());
			if(zipMe.indexOf("<>")>=0){
				String folder = zipMe.substring(0,zipMe.indexOf("<>"));
				zipMe.delete(0,zipMe.indexOf("<>")+2);
				String fileName = zipMe.toString();
				//folder = folder.substring(folder.length()-2);
				try {
					zipFolder(folder,fileName);
				} catch (Exception e) {
					System.out.println("Problem writing ZIP<>" + folder + "<>" + fileName);
					System.out.println(e.getMessage());
					e.printStackTrace();
				}
			}else{
				System.out.println("Malformed ZIP command");
			}
		}else{
			System.out.println("Unrecognized command.");
		}
	}


	static public void zipFolder(String srcFolder, String destZipFile) throws Exception {
	    ZipOutputStream zip = null;
	    FileOutputStream fileWriter = null;

	    fileWriter = new FileOutputStream(destZipFile);
	    zip = new ZipOutputStream(fileWriter);

	    addFolderToZip("", srcFolder, zip);
	    zip.flush();
	    zip.close();
	  }

	  static private void addFileToZip(String path, String srcFile, ZipOutputStream zip)
	      throws Exception {

	    File folder = new File(srcFile);
	    if (folder.isDirectory()) {
	      addFolderToZip(path, srcFile, zip);
	    } else {
	      byte[] buf = new byte[1024];
	      int len;
	      FileInputStream in = new FileInputStream(srcFile);
	      zip.putNextEntry(new ZipEntry(path + "/" + folder.getName()));
	      while ((len = in.read(buf)) > 0) {
	        zip.write(buf, 0, len);
	      }
	    }
	  }

	  static private void addFolderToZip(String path, String srcFolder, ZipOutputStream zip)
	      throws Exception {
	    File folder = new File(srcFolder);

	    for (int x=0;x< folder.list().length;x++ ) {
	    	String fileName = folder.list()[x];
	      if (path.equals("")) {
	        addFileToZip(folder.getName(), srcFolder + "/" + fileName, zip);
	      } else {
	        addFileToZip(path + "/" + folder.getName(), srcFolder + "/" + fileName, zip);
	      }
	    }
	  }

(I cheated and found the various zip methods already written online )

This is NOT a complete module as I still need to add the ability to extract from a zip file and a bunch of other nice things (like figuring out the correct path automatically), but it does create a zip file and it is compressed.

If anyone wants to try out the module, (WITH ABSOLUTELY NO WARRANTIES nor GUARANTEES!), let me know and I will send it your way. As soon as I a more polished module, I will post it.

Jeff