July 2007 - WLUG - wlug.mailman3.com

Re: [Wlug] Anyone tried this laptop/know more about it?

by Adam Keck

Looks like you are on mark, Clint. Likely too good to be true - oh well. >From Gizmodo comments: --------------- Johan Löfgren @ Jul 25th 2007 12:02PM Hello fellas. I came across this site, when searching for information about this computer. With that pricetag, it would be a brilliant surf & chat computer for me. I'm a swedish student, and I found an article in a larger web-newspaper in sweden and was amazed.. Sadly though, when reading comments all over, at swedish sites, this thing starts to smell very very rotten.. The speculation is about this beeing a scam, in the same way that you've mentioned above. There's bankrupcy issues, lies at the homepage, weird and incomplete messages from the people behind this "madison" company. The screenshots of the computer, has been found at other manufacturers. Companies, that Madison claim to work with, hasn't heard of the connection.. The things above, has been discovered by many people, at different swedish sites. Even more than that. The 4-6 week delivery time, sounds perfect to grab as much cash as possible and run. No-one can find anyone with an example of this computer. People doesn't believe this thing even exist. I recommend all of you, to wait and see how everything turns out here in sweden, before you buy this. As most swedes do right now.. Wait and see if the first computers arrive at all. I hope that this isn't a scam. I'd love to buy one. I'd love if the promised "future generation" will arrive. But this thing doesn't feel safe. Cincearly -Johan Löfgren. Orebro, Sweden -------- -Adam On 7/25/07, Clint Moyer <cdmoyer(a)charter.net> wrote: > Looks like the the $400 Acer I bought my wife at Microcenter which was a steal at that price. If you think you can get one from Sweden for $150, best of luck to you. Reading thru that site does not exactly inspire confidence. > > > ---- Adam Keck <ghostis(a)gmail.com> wrote: > > ============= > http://www.medisoncelebrity.com/product.html > > -Adam > _______________________________________________ > Wlug mailing list > Wlug(a)mail.wlug.org > http://mail.wlug.org/mailman/listinfo/wlug > > _______________________________________________ > Wlug mailing list > Wlug(a)mail.wlug.org > http://mail.wlug.org/mailman/listinfo/wlug >

July 25, 2007

Re: [Wlug] Any SQL-types out there? (more lab automation stuff)

by Tim Keller

I do a fair amount of data processing migrating between CSV and Oracle and mysql databases on both windows and linux and the weapon of choice on the windows side is ActiveState perl. You might want to persuade the IT people to let you use perl instead of VBscript. I can think of a couple compelling arguments right off the top of my head. 1. VBscript is crap! 2. Perl offers you amazing flexability to deal with CSV files. Either through direct manipulation using split/map/pack/unpack, to the CSV libraries, to the DBD libraries so you can treat the CSV file as a database and write SQL against it. 3. Perl offers equally great flexibility using DBI/DBD to interface and maniuplate databases, including MSSQL. 4. All your code will be immediately multiplatform. I'm sure it'll all fall on deaf eyes... just my two cents... Thanks, Tim. On 7/25/07, Stephen Daukas <scd(a)daukas.com> wrote: > > There are a lot of things I'd rather use, but I have to stick with the IT > standards... > > On 7/25/07, Michael Zarozinski < MichaelZ(a)aiguru.com> wrote: > > > > I think you'd be far better off using a scripting language such as perl, > > > > it's far easier to manipulate text files with perl. > > > > Michael Z > > > > Stephen Daukas wrote: > > > Good morning! > > > > > > In the continuing saga of automating various activities where I > > > work, I have taken on processing data files. (Automating data upload > > > is still somewhere in the air.)... > > > > > > This is rather simple in concept, but a bit less obvious in practice > > > (aren't they all!): > > > > > > I would like to open up a CSV file and rearrange the columns according > > > > > to a standardized order. Not every data file will have all of the > > > standard columns (different probes collect different data), but column > > > headers are standardized. So, I need to inspect each column header so > > > > > that I can place it and its entire column of data into the > > > proper position in the table, with empty columns inserted where needed > > > to preserve the standard sequence of columns. In other words: > > > > > > A, D, C, G, H becomes A, [B], C, D, [E], [F], G, H > > > where [ ] denote inserted empty columns > > > > > > There are literally hundreds of files of data in CSV format, and I > > > intend to process each by itself, preserving the original, and > > > creating a new "adjusted" file for the next step. (The next step > > > would be to concatenate all files together for numeric processing.) > > > Original files must be preserved (chain of custody requirements), so I > > > > > am opening the file, selecting records using SQL, and am now ready to > > > do the rearranging/writing to a new file... > > > > > > I didn't know if there is a "well known" SQL way of doing this ( e.g., > > > data manipulation statements of some sort), so I thought I'd see if > > > any WLUGgers are also SQL-types. I have a few ideas for how to get > > > this done, but they are "programmer-centric" algorithms, which tend to > > > > > be different from "SQL-centric" algorithms... > > > > > > The reason for SQL is that I have to do this on a MS platform because > > > that is the standard. But, if most of the real work is done in SQL, > > > then I can easily move to another platform in the future and only have > > > to change the "shell code". I am using VBscript as the "shell > > > language" because it works with all MS apps and file system objects > > > inclusive of CSV files. > > > > > > Thanks for any help!!! > > > > > > Best regards, > > > Steve > > > > > ------------------------------------------------------------------------ > > > > > > _______________________________________________ > > > Wlug mailing list > > > Wlug(a)mail.wlug.org > > > http://mail.wlug.org/mailman/listinfo/wlug > > > > > _______________________________________________ > > Wlug mailing list > > Wlug(a)mail.wlug.org > > http://mail.wlug.org/mailman/listinfo/wlug > > > > > _______________________________________________ > Wlug mailing list > Wlug(a)mail.wlug.org > http://mail.wlug.org/mailman/listinfo/wlug > > -- I am leary of the allegiances of any politician who refers to their constituents as "consumers".

July 25, 2007

Re: [Wlug] Any SQL-types out there? (more lab automation stuff)

by Stephen Daukas

There is (was) a commercial package that had awk, sed, grep, et al. and when I used it (pre XP) it did a fine job. I can't remember the name off hand, but I think it originated in Israel. Since then, I have occasionally come across a package or two, but I never took a closer look since I get this automatically on Linux... Given the "rules" regarding standardization where I work, it wouldn't be an option for me... If it smells like a PC and looks like a PC, then the IT division owns it to the point where you have to get permission to change your desktop configuration! I can't even auto-update as I do not have administrator permissions... Steve On 7/25/07, Eric Martin <freak4uxxx(a)gmail.com> wrote: > > does awk compile on windows? > > On 7/25/07, Michael Long <mlong(a)datalong.com> wrote: > > > > Chuck Anderson wrote: > > > On Wed, Jul 25, 2007 at 09:29:43AM -0400, Stephen Daukas wrote: > > >> There are literally hundreds of files of data in CSV format, and I > > intend to > > >> process each by itself, preserving the original, and creating a new > > >> "adjusted" file for the next step. (The next step would be to > > concatenate > > >> all files together for numeric processing.) Original files must be > > >> preserved (chain of custody requirements), so I am opening the file, > > >> selecting records using SQL, and am now ready to do the > > rearranging/writing > > >> to a new file... > > > > > > So you are selecting records out of a CSV file using SQL? How about > > > this: > > > > > > select columnB,columnG,columnA,columnC,columnF from foo; > > > > > > That will take the columns and return them in the given order. > > > _______________________________________________ > > > > That will work if the column order of the csv file is known. If the > > files come in with the columns in different orders and you have to > > examine the headers to determine the order or the data then it becomes > > more complex. > > > > If he really wants to do this in sql then you could bulk load the data > > into a worktable with all columns defined and char or varchar. When the > > data is loaded make sure you have a unique key for each row by defining > > one of the columns as an identity column. > > > > create table foo ( > > col1 identity(1,1), col2 varchar(25), col3 varchar(25) > > ) > > > > Once the data is imported you could right a sql script that will move > > the data based on the value found in the first record. > > > > if (select col2 from foo where col1 = 1) = 'myHeader' > > begin > > insert into myTable(myHeader) > > select col2 from foo > > end > > > > if (select col3 from foo where col1 = 1) = 'myHeader' > > begin > > insert into myTable(myHeader) > > select col3 from foo where col1 > 1 > > end > > > > Repeat this as necessary. Also be careful to keep the rows ordered as > > you move the data around. You will also need to reset the identity value > > between loads or come up with a method to deal with an incrementing > > number. > > > > > > _______________________________________________ > > Wlug mailing list > > Wlug(a)mail.wlug.org > > http://mail.wlug.org/mailman/listinfo/wlug > > > > > _______________________________________________ > Wlug mailing list > Wlug(a)mail.wlug.org > http://mail.wlug.org/mailman/listinfo/wlug > > -- Stephen C. Daukas Engineer, Geoscientist, Environmental Analyst ________________________________________________ - Please, before printing, think about the environment -

July 25, 2007

Re: [Wlug] Anyone tried this laptop/know more about it?

by Clint Moyer

Looks like the the $400 Acer I bought my wife at Microcenter which was a steal at that price. If you think you can get one from Sweden for $150, best of luck to you. Reading thru that site does not exactly inspire confidence. ---- Adam Keck <ghostis(a)gmail.com> wrote: ============= http://www.medisoncelebrity.com/product.html -Adam _______________________________________________ Wlug mailing list Wlug(a)mail.wlug.org http://mail.wlug.org/mailman/listinfo/wlug

July 25, 2007

Re: [Wlug] Any SQL-types out there? (more lab automation stuff)

by Eric Martin

does awk compile on windows? On 7/25/07, Michael Long <mlong(a)datalong.com> wrote: > > Chuck Anderson wrote: > > On Wed, Jul 25, 2007 at 09:29:43AM -0400, Stephen Daukas wrote: > >> There are literally hundreds of files of data in CSV format, and I > intend to > >> process each by itself, preserving the original, and creating a new > >> "adjusted" file for the next step. (The next step would be to > concatenate > >> all files together for numeric processing.) Original files must be > >> preserved (chain of custody requirements), so I am opening the file, > >> selecting records using SQL, and am now ready to do the > rearranging/writing > >> to a new file... > > > > So you are selecting records out of a CSV file using SQL? How about > > this: > > > > select columnB,columnG,columnA,columnC,columnF from foo; > > > > That will take the columns and return them in the given order. > > _______________________________________________ > > That will work if the column order of the csv file is known. If the > files come in with the columns in different orders and you have to > examine the headers to determine the order or the data then it becomes > more complex. > > If he really wants to do this in sql then you could bulk load the data > into a worktable with all columns defined and char or varchar. When the > data is loaded make sure you have a unique key for each row by defining > one of the columns as an identity column. > > create table foo ( > col1 identity(1,1), col2 varchar(25), col3 varchar(25) > ) > > Once the data is imported you could right a sql script that will move > the data based on the value found in the first record. > > if (select col2 from foo where col1 = 1) = 'myHeader' > begin > insert into myTable(myHeader) > select col2 from foo > end > > if (select col3 from foo where col1 = 1) = 'myHeader' > begin > insert into myTable(myHeader) > select col3 from foo where col1 > 1 > end > > Repeat this as necessary. Also be careful to keep the rows ordered as > you move the data around. You will also need to reset the identity value > between loads or come up with a method to deal with an incrementing > number. > > > _______________________________________________ > Wlug mailing list > Wlug(a)mail.wlug.org > http://mail.wlug.org/mailman/listinfo/wlug >

July 25, 2007

Anyone tried this laptop/know more about it?

by Adam Keck

http://www.medisoncelebrity.com/product.html -Adam

July 25, 2007

Re: [Wlug] Any SQL-types out there? (more lab automation stuff)

by Stephen Daukas

I received an incredibly useful suggestion from a fellow WLUGger that I am coming up to speed on. I'll fill you in when I'm confident I "get" what he is trying to "learn me". Its probably "SQL 101" for database types, but I'll provide a summary of what I end up with just the same. Definitely a SQL solution! Steve On 7/25/07, Stephen Daukas <scd(a)daukas.com> wrote: > > Hi Chuck! > > If I knew the order of the columns a priori, that would work, but sadly I > don't. The number of columns, as well as the order, are random due to the > fact that different sondes collect different data. In fact, my plan was to > first determine the order of the columns in the source file, then I thought > about using ALTER TABLE (in combination with SELECT column-of-interest) to > put each column, one-by-one, into the new table in the proper order - last > to first. If I select columns as you suggest, I still have to insert > "empty" columns to maintain the proper column order, and I haven't found a > way to insert a column into the middle of a table. (ALTER TABLE always > creates a new column at the front of the table.) > > I was also thinking of biting the bullet and learning about MS JET (ODBC > provider) attributes/field names as a way of discovering what fields > (columns) are available, but I'm trying to keep this as close to "token > handling" as possible so I can easily cleave MS-specific file stuff from the > meat of the program. > > Correct me if I'm wrong on this - my SQL experience is on the order of 15 > years old and I only just taught myself VB scrpt a few weeks ago... > > Steve > > On 7/25/07, Chuck Anderson <cra(a)wpi.edu> wrote: > > > > On Wed, Jul 25, 2007 at 09:29:43AM -0400, Stephen Daukas wrote: > > > There are literally hundreds of files of data in CSV format, and I > > intend to > > > process each by itself, preserving the original, and creating a new > > > "adjusted" file for the next step. (The next step would be to > > concatenate > > > all files together for numeric processing.) Original files must be > > > preserved (chain of custody requirements), so I am opening the file, > > > selecting records using SQL, and am now ready to do the > > rearranging/writing > > > to a new file... > > > > So you are selecting records out of a CSV file using SQL? How about > > this: > > > > select columnB,columnG,columnA,columnC,columnF from foo; > > > > That will take the columns and return them in the given order. > > _______________________________________________ > > Wlug mailing list > > Wlug(a)mail.wlug.org > > http://mail.wlug.org/mailman/listinfo/wlug > > > >

July 25, 2007

BBQ Stuff

by Eric Martin

Ok, so far I have about 10 people RSVP'd as a yes. I'm hitting the grocery store tonight so please let me know if you haven't already. Also, if a few people could bring chairs that would be awesome, I only have 10 and I couldn't grab any more. Lastly, it's BYOB just so everyone knows, and I will have a cooler w/ice so we can keep stuff cold. See you tomorrow night at 7, right Andy? Eric

July 25, 2007

Re: [Wlug] Any SQL-types out there? (more lab automation stuff)

by Stephen Daukas

Hi Chuck! If I knew the order of the columns a priori, that would work, but sadly I don't. The number of columns, as well as the order, are random due to the fact that different sondes collect different data. In fact, my plan was to first determine the order of the columns in the source file, then I thought about using ALTER TABLE (in combination with SELECT column-of-interest) to put each column, one-by-one, into the new table in the proper order - last to first. If I select columns as you suggest, I still have to insert "empty" columns to maintain the proper column order, and I haven't found a way to insert a column into the middle of a table. (ALTER TABLE always creates a new column at the front of the table.) I was also thinking of biting the bullet and learning about MS JET (ODBC provider) attributes/field names as a way of discovering what fields (columns) are available, but I'm trying to keep this as close to "token handling" as possible so I can easily cleave MS-specific file stuff from the meat of the program. Correct me if I'm wrong on this - my SQL experience is on the order of 15 years old and I only just taught myself VB scrpt a few weeks ago... Steve On 7/25/07, Chuck Anderson <cra(a)wpi.edu> wrote: > > On Wed, Jul 25, 2007 at 09:29:43AM -0400, Stephen Daukas wrote: > > There are literally hundreds of files of data in CSV format, and I > intend to > > process each by itself, preserving the original, and creating a new > > "adjusted" file for the next step. (The next step would be to > concatenate > > all files together for numeric processing.) Original files must be > > preserved (chain of custody requirements), so I am opening the file, > > selecting records using SQL, and am now ready to do the > rearranging/writing > > to a new file... > > So you are selecting records out of a CSV file using SQL? How about > this: > > select columnB,columnG,columnA,columnC,columnF from foo; > > That will take the columns and return them in the given order. > _______________________________________________ > Wlug mailing list > Wlug(a)mail.wlug.org > http://mail.wlug.org/mailman/listinfo/wlug >

July 25, 2007

Re: [Wlug] Any SQL-types out there? (more lab automation stuff)

by Michael Long

Chuck Anderson wrote: > On Wed, Jul 25, 2007 at 09:29:43AM -0400, Stephen Daukas wrote: >> There are literally hundreds of files of data in CSV format, and I intend to >> process each by itself, preserving the original, and creating a new >> "adjusted" file for the next step. (The next step would be to concatenate >> all files together for numeric processing.) Original files must be >> preserved (chain of custody requirements), so I am opening the file, >> selecting records using SQL, and am now ready to do the rearranging/writing >> to a new file... > > So you are selecting records out of a CSV file using SQL? How about > this: > > select columnB,columnG,columnA,columnC,columnF from foo; > > That will take the columns and return them in the given order. > _______________________________________________ That will work if the column order of the csv file is known. If the files come in with the columns in different orders and you have to examine the headers to determine the order or the data then it becomes more complex. If he really wants to do this in sql then you could bulk load the data into a worktable with all columns defined and char or varchar. When the data is loaded make sure you have a unique key for each row by defining one of the columns as an identity column. create table foo ( col1 identity(1,1), col2 varchar(25), col3 varchar(25) ) Once the data is imported you could right a sql script that will move the data based on the value found in the first record. if (select col2 from foo where col1 = 1) = 'myHeader' begin insert into myTable(myHeader) select col2 from foo end if (select col3 from foo where col1 = 1) = 'myHeader' begin insert into myTable(myHeader) select col3 from foo where col1 > 1 end Repeat this as necessary. Also be careful to keep the rows ordered as you move the data around. You will also need to reset the identity value between loads or come up with a method to deal with an incrementing number.

July 25, 2007