Yesterday we crafted a new Yahoo! Backlinks uploader. We did this on behalf of an agency that plans to use the Client Center to monitor a large number of addresses, as many as 750,000. The file that we used to import contained over a million addresses because of duplications. It was over 70 megabytes of plain text.
We worked over the data, adding the necessary whitespace delimiters (tabs) and text (including URI escape chars) to model the file after a Yahoo! Site Explorer backlinks TSV export. That was necessary for it to work with our uploader. The new worked-over file ended up being over 90 megabytes.
Our original code for the uploader was built for Yahoo! exclusively, although we could format files and use it. That was moving too slow for us for this bigger file. So we set about the job of upgrading the parser and data extraction routine for addresses. The new extraction routine will simplify the rules for many more file format.
We now have a version operating at lightning speed. All users should notice a speed difference immediately. If you experience any problems at anytime, for any matter relating to the Client Center, please notify us by one of many means by which you can reach us. Free support is available through Twitter. We'll make another announcement when new file formats are supported.
Stay tuned.
Leave a comment