Google Search  |  Meridian Systems  |  Meridian Streaming  |  Restaurant  |  WiKi  |  Duncan's Meridian Info  |  Board Rules  |  Restaurant Rules
Page 1 of 2 1 2 >
Topic Options
Rate This Topic
#271913 - 2018-01-16 21:48 Export speed guess?
Registered: 2017-12-23
Posts: 26
HalJayGreene Offline
Harmless
HalJayGreene Offline
Harmless

Registered: 2017-12-23
Posts: 26
Loc: Denver, CO, USA
Hi All,

Quick question:

I did two complete backups of my Sooloos DB (one from a Mac, one from Windows), which shows around 9k albums. Each took about 3 days. Whew!

Now I'm trying to do a full FLAC export of everything in anticipation for switching over to Roon. I started with the Windows version (Control:PC) but it kept hanging after a few thousand tracks, so I switched to the Mac version (Control:Mac). After 24 hours, about 15k tracks have been transferred to a late-model QNAP NAS, hard-wired through a TP-Link switch to a Mac router. At this rate I guess the complete export will take about a week, based upon a track count of 121k.

Is this a reasonable rate of transfer? Why are transfer of tracks so much slower than backups? Is it because of the NAS? Both backups were done to USB drives connected directly to the computer. Is there a faster method?


Thanks,


Hal

Top
#271942 - 2018-01-17 16:12 Re: Export speed guess? [Re: HalJayGreene]
Registered: 2002-02-14
Posts: 8,458
ncpl Offline
President of the Imperial Galactic Government
ncpl Offline

President of the Imperial Galactic Government

Registered: 2002-02-14
Posts: 8,458
Loc: Surrey, UK
Hi Hal,

same as I said on the Roon forum wink

IMHO exporting across the network (to a NAS) was a very slow process. My conclusion was that the tagtool.exe (which within Sooloos tags the untagged Sooloos music files to become regular tagged files) does NOT work across network locations.

If you re-run the export to a local drive (e.g. your USB drive) then it should run significantly faster.


Rgds,
Nick

#15SE
Top
#271943 - 2018-01-17 16:18 Re: Export speed guess? [Re: ncpl]
Registered: 2010-12-09
Posts: 3,530
Ratbert Offline
Ravenous Bugblatter Beast of Traal
Ratbert Offline
Ravenous Bugblatter Beast of Traal

Registered: 2010-12-09
Posts: 3,530
Loc: Europe
+1, and ensure the PC or Mac is connected via Ethernet not wireless as that also made a significant performance difference.


Never pass up a good chance to shut up!
Top
#271944 - 2018-01-17 16:25 Re: Export speed guess? [Re: ncpl]
Registered: 2017-12-23
Posts: 26
HalJayGreene Offline
Harmless
HalJayGreene Offline
Harmless

Registered: 2017-12-23
Posts: 26
Loc: Denver, CO, USA
So what happens to the files when they are exported across a network? Will there be something defective about them re: tagtool.exe error? Should I just cancel this export (three days and 45k files running) and switch over to a connected drive?

Top
#271945 - 2018-01-17 16:56 Re: Export speed guess? [Re: HalJayGreene]
Registered: 2004-12-09
Posts: 6,267
ChrisLayerUK Online content
President of the Imperial Galactic Government
ChrisLayerUK Online content
President of the Imperial Galactic Government

Registered: 2004-12-09
Posts: 6,267
Loc: Colchester, Essex, UK
I would expect the network to be slower.


No 18 in the Hall of fame smile I have simple tastes; I am content to settle for the best: GIK monster bass panels, rear wall.
MC200 500GB, QNAP TVS 471i3. Roon into 2 MS200's. Explorer 2. Bluesound Pulse 2 and Mini. 596 v1.89.2, 518, G61R, M60.2 Rosewood, M33C, M33 Rears, M1500 Sub, Foxsat HD, Sony Blu Ray, Pioneer 5090, 2 Chromecast's for LRB videos.
Top
#271946 - 2018-01-17 16:58 Re: Export speed guess? [Re: HalJayGreene]
Registered: 2002-02-14
Posts: 8,458
ncpl Offline
President of the Imperial Galactic Government
ncpl Offline

President of the Imperial Galactic Government

Registered: 2002-02-14
Posts: 8,458
Loc: Surrey, UK
Nothing as far as I recall is wrong with them. It is just that something about tagtool.exe across a network drive doesn't work well and it takes a stupidly long time.

Cancel that export and start a new one on a local drive. Your library won't take too long. I think at USB3.0 speeds you should see an album per minute.


Rgds,
Nick

#15SE
Top
#272012 - 2018-01-19 14:49 Re: Export speed guess? [Re: HalJayGreene]
Registered: 2017-12-23
Posts: 26
HalJayGreene Offline
Harmless
HalJayGreene Offline
Harmless

Registered: 2017-12-23
Posts: 26
Loc: Denver, CO, USA
I started an export on the same drive as the Sooloos DB. The drive is 6TB and the Sooloos DB takes up less than half of that. I expected the export to fit in the other half, but after only 2/3 progress the export failed due to a full target disk.

Is the export significantly larger than the DB? How can I guesstimate the size of the export?

Top
#272015 - 2018-01-19 15:35 Re: Export speed guess? [Re: HalJayGreene]
Registered: 2002-02-14
Posts: 8,458
ncpl Offline
President of the Imperial Galactic Government
ncpl Offline

President of the Imperial Galactic Government

Registered: 2002-02-14
Posts: 8,458
Loc: Surrey, UK
The export will be similar in size to the music2 folder in your Sooloos store. That is where the files are.

Also, what does your Sooloos summary page, see Sooloos Library Stats tell you?




Rgds,
Nick

#15SE
Top
#272016 - 2018-01-19 15:40 Re: Export speed guess? [Re: ncpl]
Registered: 2008-05-23
Posts: 7,751
Carl Offline
President of the Imperial Galactic Government
Carl Offline


President of the Imperial Galactic Government

Registered: 2008-05-23
Posts: 7,751
Loc: Central England, UK
Not overly significant but worth noting ... in Sooloos there is only one copy of the album artwork for each album, when exported the artwork is embedded into each album track file.


861v6+ID40, HD621, 8000.2, 7200HC, 7200, SKYQ Silver, PS3, PDP-LX6090, QNAP TS870-Pro (8*6TB), Roon, iPadAir2.
[In Reserve] C15, MD600 (2*3TB), TwinStore RM (2*2TB)
Top
#272021 - 2018-01-19 19:00 Re: Export speed guess? [Re: HalJayGreene]
Registered: 2014-07-14
Posts: 21
ScotAV Offline
Harmless
ScotAV Offline
Harmless

Registered: 2014-07-14
Posts: 21
Loc: Central Scotland
I recently rebuilt my system and am running the Roon trial. I performed a Native Export of my Sooloos library and expected this to be more or less the same size as my existing library approx. 1TB, some 3500 albums.

To my surprise the Native Export size was approximately 50% larger than my Sooloos library at around 1.5TB. I don't know the reason for this but others may know the answer? There are no duplicate albums in the export library and it shows more or less the same amount of 3500 albums. This ties up with what you have experienced carrying out your export.

I know this may not be of any help to you but at least you know that I have experienced the same issue.


Scotav
Top
#272040 - 2018-01-19 22:50 Re: Export speed guess? [Re: ScotAV]
Registered: 2017-12-23
Posts: 26
HalJayGreene Offline
Harmless
HalJayGreene Offline
Harmless

Registered: 2017-12-23
Posts: 26
Loc: Denver, CO, USA
This is what I see:

Top
#272065 - 2018-01-20 09:42 Re: Export speed guess? [Re: HalJayGreene]
Registered: 2002-02-14
Posts: 8,458
ncpl Offline
President of the Imperial Galactic Government
ncpl Offline

President of the Imperial Galactic Government

Registered: 2002-02-14
Posts: 8,458
Loc: Surrey, UK
This tells you that you have approx 2.7TB of library on Sooloos.

The export will be not less than this.

Take Carl’s point about artwork and estimate that 122,000 tracks will embed a cover art of whatever size your typical artwork is.

That should give you a ball park figure.

Take from the stats thread I linked above and multiply your 9000 albums by an average of maybe 350mb or 400mb per album

This would suggest between 3TB and 4TB as well.

Does this match what you found so far?


Rgds,
Nick

#15SE
Top
Page 1 of 2 1 2 >

Moderator:  Carl, Duncs, ncpl 
Who's Online
1 registered (ChrisLayerUK), 45 Guests and 6 Spiders online.
Key: Admin, Global Mod, Mod
Newest Members
ShowaSanke, JustAlex, QuantumAudio, Phil66, MrTechGuy
4657 Registered Users
Top Posters (30 Days)
Ratbert 45
Carl 31
CMB Integrations - Bruce 19
X999 15
Mtns 15
Top Posters
VirusKiller 12370
Fiddler 8667
ncpl 8458
Carl 7751
Ian 7513
Forum Stats
4,657 Registered Members
18 Forums
25,328 Topics
256,558 Posts

Most users ever online: 211 @ 2015-05-05 14:40
Meridian  |  Media Centre  |  Support  |  Firmware Release Notes  |  RSS Systems  |  RSS Streaming  |  RSS Restaurant