Mfs_Ftp: extract, archive, restore & transfer recordings

**petey256** · 10-28-2005, 08:03 PM

Did you ever get an answer or figure it out? I have the same problem and am going to try a different ftp on my pc(flashfx) although I dont think SmartFtp is the problem unless it is a setting Ive missed or havnt tried. Anyone have any ideas? Thanks

**citivolus** · 10-29-2005, 01:40 AM

Originally Posted by mr_zorg

FYI, I updated my system to an updated version of MFS_FTP and usb/networking drivers found elsewhere on this board and things have been rock solid ever since. Not one crash. And, no hiccups or slow tivo during extraction either.

mr_zorg,
could you describe exactly what versions you updated? I'm having similar network instability (as described by others in this thread) when extracting shows on my HR10-250 HDTivo through ETivo and mfs_ftp.

thanks.

**ebmarquez** · 11-15-2005, 01:07 AM

mfs_ftp crashes everytime I start it. Is there something I need to change in the script to get it to work corectly?
I read through the instructions to get it up and working I'm still have a problem.
It looks like the script is having a problem when it makes it call the to tzoffset.tcl script. Could somebody please give me a hand with this problem.
Thanks in advance...

Version: mfs_ftp.1.2.9p.tar.zip
tivo-TiVo# chmod +x /var/mfs_ftp/*
tivo-TiVo# /var/mfs_ftp/mfs_ftp.tcl &
[1] 7917
tivo-TiVo# child process exited abnormally
while executing
"exec $info(path)/tzoffset.tcl 2>/dev/null"
(procedure "get_tzoffset" line 10)
invoked from within
"get_tzoffset"
(procedure "init_procs" line 7)
invoked from within
"init_procs"
(file "/var/mfs_ftp/mfs_ftp.tcl" line 1534)

[1]+ Done /var/mfs_ftp/mfs_ftp.tcl
#############
tivo-TiVo# tail port.3105.log
05:44:35:AM - sourcing settings

uname -a
Linux (none) 2.4.20 #22 Fri Feb 20 18:19:25 PST 2004 mips unknown
Direct Tivo RCA 40GB

**Jamie** · 11-15-2005, 03:08 AM

Follow the thread starting here.

**jasch** · 11-23-2005, 05:10 PM

I am having trouble transferring some files. The transfer stops inmediatelly. Sometimes the Tivo I am inserting the programs even reboots.

I was able to extract if from another tivo perfectly, yet I cannot insert it. FXP from Tivo to Tivo doesn't work either. (but works with other streams).

Code:

09:07:16:PM - 226 Transfer complete.
09:07:26:PM - readlinefromsocket: "sock22"
09:07:26:PM - echo to verify: "SIZE {Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf"
09:07:26:PM - parseline:
"SIZE {Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf"
09:07:26:PM - 502 Command not implemented "SIZE {Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf"
09:07:26:PM - readlinefromsocket: "sock22"
09:07:26:PM - echo to verify: "PORT 192,168,0,18,12,32"
09:07:26:PM - parseline:
"PORT 192,168,0,18,12,32"
09:07:26:PM - PORT 192,168,0,18,12,32
09:07:26:PM - data channel "sock23" to 192.168.0.18:3104
09:07:26:PM - 200 PORT command successful.
09:07:26:PM - readlinefromsocket: "sock22"
09:07:26:PM - echo to verify: "STOR {Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf"
09:07:26:PM - parseline:
"STOR {Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf"
09:07:26:PM - STOR:
"STOR {Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf"
09:07:26:PM - make_blank_rec: "{Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf"
09:07:26:PM - created blank recording {354250}
09:07:26:PM - rec_info_from_db: recobj{354250}
09:07:26:PM - Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf  k
09:07:26:PM - cache_xml_2_disk: recobj{354250}  force cache = "0"
09:07:26:PM - recording in progress, don't cache 354250.xml yet
09:07:26:PM - calc_tertiary_info: recobj{354250}
09:07:26:PM - 150 Opening BINARY mode data connection for "{{Masseusse}{1970-01-01}{}{04.44 PM Tue Nov 04, 2003}{{}}.tmf}"
09:07:26:PM - parse_tmf:
09:07:26:PM - xml_from_tmf:
09:07:27:PM - tarpart is "showing.xml"
09:07:27:PM - open/create "./cache/354250.xml" & writing
<?xml version="1.1" tivoversion="7.2.1-oth-01-2-540"?>
<Object type="Recording" id="_top">
  <AuxiliaryData>46</AuxiliaryData>
  <AuxiliaryData>50344978</AuxiliaryData>
  <AuxiliaryData>-761593344</AuxiliaryData>
  <AuxiliaryData>-933553663</AuxiliaryData>
  <AuxiliaryData>503316480</AuxiliaryData>
  <AuxiliaryData>436207616</AuxiliaryData>
  <AuxiliaryData>1261589582</AuxiliaryData>
  <AuxiliaryData>810963539</AuxiliaryData>
  <AuxiliaryData>1093148725</AuxiliaryData>
  <AuxiliaryData>1852403044</AuxiliaryData>
  <AuxiliaryData>1920234345</AuxiliaryData>
  <AuxiliaryData>1919906913</AuxiliaryData>
  <AuxiliaryData>41</AuxiliaryData>
  <BitRate>0</BitRate>
  <BitstreamFormat>59</BitstreamFormat>
  <BitstreamFormat>50344978</BitstreamFormat>
  <BitstreamFormat>335675648</BitstreamFormat>
  <BitstreamFormat>-2015482111</BitstreamFormat>
  <BitstreamFormat>721420288</BitstreamFormat>
  <BitstreamFormat>16777216</BitstreamFormat>
  <BitstreamFormat>587202560</BitstreamFormat>
  <BitstreamFormat>520093696</BitstreamFormat>
  <BitstreamFormat>50344978</BitstreamFormat>
  <BitstreamFormat>973209856</BitstreamFormat>
  <BitstreamFormat>1460456193</BitstreamFormat>
  <BitstreamFormat>251658240</BitstreamFormat>
  <BitstreamFormat>67108864</BitstreamFormat>
  <BitstreamFormat>0</BitstreamFormat>
  <BitstreamFormat>50331648</BitstreamFormat>
  <BitstreamFormat>0</BitstreamFormat>
 <SubObject type="RecordingPart" id="Part">
   <Begin>0</Begin>
   <CommercialSkipOffset>0</CommercialSkipOffset>
   <End>5519019</End>
   <File>326924</File>
 </SubObject>
  <RecordQuality>255</RecordQuality>
  <SelectionType>3</SelectionType>
 <SubObject type="Showing" id="Showing">
   <Date>13110</Date>
   <Duration>0</Duration>
   <NetworkURL>http://192.168.0.136:8080/TiVoConnect/TivoNowPlaying/IMasseusse.mpg?Format=video%2Fmpeg</NetworkURL>
  <Object type="Program" id="Program">
    <Title>Masseusse</Title>
  </Object>
   <Reason>4</Reason>
  <Object type="Station" id="Station">
  </Object>
   <Time>60267</Time>
 </SubObject>
  <StartDate>13110</StartDate>
  <StartTime>60271</StartTime>
  <StopDate>13110</StopDate>
  <StopTime>62533</StopTime>
  <StreamFileSize>1875968</StreamFileSize>
  <UsedBy>1</UsedBy>
</Object>


09:07:27:PM - parse_xml:
09:07:27:PM - Title is "Masseusse"
09:07:27:PM - Description is ""
09:07:27:PM - EpisodeTitle is ""
09:07:27:PM - StartDate is "13110"
09:07:27:PM - StopDate is "13110"
09:07:27:PM - StartTime is "60271"
09:07:27:PM - StopTime is "62533"
09:07:27:PM - Duration is "0"
09:07:27:PM - Date is "13110"
09:07:27:PM - OriginalAirDate is ""
09:07:27:PM - CallSign is ""
09:07:27:PM - Name is ""
09:07:27:PM - Time is "60267"
09:07:27:PM - "0 0 5519019"
09:07:27:PM - setrecinfo: recobj{354250}
09:07:27:PM - {Masseusse}{}

09:07:27:PM - tmf2fsid: recobj{354250}
09:07:27:PM - starting segment "part00.ty"
bgerror invoked with error 
 
 " integer value too large to represent " 

re-initializing mfs_ftp

close the current ftp connection and simply open another

"core dump" :p

info(version): 1.2.9p
info(tswv): 6.2-01-2-321
info(dbl): 5
info(ithrottle): 2
info(insert_priority): 10
info(multithreaded): 0
info(saveuntil): suggestion
info(name_detail): 5
info(bjuggle): 0
info(active): 0
info(ac_interval): 1800
info(gatewayip): 127.0.0.1
info(gatewayport): 3105

**lenoxb** · 12-03-2005, 03:52 AM

I have spent a couple of weeks applying hacks to my two HD Tivos. So far, I’ve been getting answers to everything by searching in these threads (thanks to everyone for all the hard work), but now I am stumped.

I am able to use SmartFTP and mfs_ftp to drag and drop shows from one TiVo to another. Now I would like to archive a bunch of shows in .tmf format on a Windows PC using NTFS (so the 4GB limit isn’t an issue). When I try to use SmartFTP’s Global Queue (even with a single item in the queue), downloads seem to be going just fine, but SmartFTP goes into a loop and starts downloading again. This doesn’t happen when I download “conventional” files from FTP servers using the Global Queue.

I tried a direct download to copy a single .tmf file and found (after getting the SmartFTP message “File size mismatch Transfer failed”) that the size on the receiving PC was larger than the size reported by the TiVo. I am guessing that the size discrepancy is what’s causing downloading via the Global Queue to loop for me.

From what I read here, the size discrepancy is not unexpected. From what I read on the SmartFTP.com support pages, size checking has not always been in SmartFTP, but is a recent addition.

Global Queue seems to have a bunch of advantages if I can make it work. (Among others, it can restart interrupted transfers and deal with a big block of files overnight.) Has anyone had any success making this happen?

Failing this, does anyone have a good solution to the problem of transferring a bunch of large shows to PC?

**jerrywoody** · 12-03-2005, 05:37 AM

uploaded recordings always seemed to expire immediately, which was annoying me. I took a look at the mfs_ftp.tcl code, and it seems to me that this line:

Code:

   dbobj $recording set ExpirationDate [expr $date + 7*86400]

is incorrect... there's no need to multiply 7*86400, because the value is supposed to be in days. I changed it to just

Code:

   dbobj $recording set ExpirationDate [expr $date + 7]

Everything seems to work as expected now. Thought I'd contribute in case this issue had been bugging someone else.

**Aecer** · 12-30-2005, 10:03 AM

Christmas has come and I got my new Turbonet card installed in TiVo2. I want to FXP transfer recordings from my stand alone S1 TiVo1 to my SA S1 TiVo2. I'm running latest v.3 software and mfs_ftp.1.2.9p on both. Extraction to PC works fine on both at 1.2-1.4 MB/s and insertion works OK at about half that rate. Here's what I've tried.

I've installed latest version of SmartFTP (1.5 something)

I've read the entire thread here (yes 66 some pages - I wrote a custom script and used Lynx on Cygwin to download it all)

I've set the sending SmartFTP to Passive and the receiving to active, and all other combos I can think of.

With two copies of SmartFTP running, I'm dragging a .tmf file from the right side (.tmf file list) of the source TiVo to the right side (file list) of the destination window. Nothing seems to happen in either the log file on the TiVo (watched with tail) or in the SmartFTP windows. I do see a "+" symbol on the cursor as I drag, but nothing happens, and there's no file on the destination after this process.

I did read a message from someone who said he had a similar problem that he tracked to the same MAC address on both machines. I *am* running the same copy of the software (lba48 mod) on both machines, and I tracked the MAC address to the bootpage parameters, and changed it on one. I'm uncertain as to whether this really changed the MAC address, because I notice bootpage also shows an IP address that certainly does *not* match my IP address assigned by rc.sysinit.arch. The MAC addresses do show as different on bootpage after my change. I've rebooted.

I've tried all speed enhancements I can find from runideturbo=false to hdparms and TCPOptimizer, but without much effect on speed and none on this probelm.

Could it be something as simple as I'm not dragging from the right place to the right destination in SmartFTP? I found no clear instructions on how to do this, but I tried various permutations, dragging to the .tmf folder icon instead of the window, etc.

I've run out of things I can think of to try.

BTW, OHM works OK for me, but it seems to be kind of dead.

Thanks for any help or debugging suggestions.

**wayner** · 12-30-2005, 10:29 AM

You said you have two version of SmartFTP running? Maybe I am misunderstanding you but you should have one version of SmartFTP where you open two windows, one for each TiVo and then you drag and drop from the source to destination.

**Aecer** · 12-30-2005, 11:26 AM

Originally Posted by wayner

You said you have two version of SmartFTP running? Maybe I am misunderstanding you but you should have one version of SmartFTP where you open two windows, one for each TiVo and then you drag and drop from the source to destination.

Doh! You weren't misunderstanding me at all. I've never used SmartFTP before, only FTP programs where a single connection is made, and I've always just run the FTP program multiple times to make multiple unrelated, but simultaneous, connections. It never occurred to me that I could open two windows in the same instance. I'll bet that's it. Thanks!

**eastwind** · 12-30-2005, 01:14 PM

ifconfig will show you the MAC address in use. Try executing it on both machines and comparing the results.

ew

**Aecer** · 12-30-2005, 02:57 PM

Originally Posted by eastwind

ifconfig will show you the MAC address in use. Try executing it on both machines and comparing the results.

Thanks. The MAC addresses are different, but it was wayner's answer that got me moving again - I needed to do this within a single instance of SmartFTP, with two windows open.

I tried it from my remote access and it's at least responding like something is happening. It's now giving me a "command not supported: SIZE" error, and the FXP transfer fails, but I should be able to track it down once I get home and check the logs, and do some research.

**stevel** · 12-31-2005, 06:02 PM

The "command not supported: SIZE" message is normal and can be ignored (though I'm puzzled why it happens.) I was never able to get FXP working between two TiVos using SmartFTP.

**Jamie** · 12-31-2005, 06:23 PM

Originally Posted by stevel

The "command not supported: SIZE" message is normal and can be ignored (though I'm puzzled why it happens.)

http://www.dealdatabase.com/forum/sh...FTP#post232152

**stevel** · 12-31-2005, 07:52 PM

Ah, thanks. I had independently discovered the "continue on error" setting. It had been so long since I had last used mfs_ftp that I didn't remember that it was new behavior.

Thread: Mfs_Ftp: extract, archive, restore & transfer recordings

Thread Tools

Rate This Thread

Display

Same exact problem

mfs_ftp crashing when started

mfs_ftp/SmartFTP, Global Queue, and file size mismatches

expiration fix

FXP - SmartFTP - SAS1 2 SAS1 - What am I doing wrong?

Posting Permissions