Dear CTPP Users:
Please find attached the CTPP 2006-2010 software cheat sheets that we have
developed. For example, if you are trying to get tract to tract or TAZ to
TAZ flows for multiple counties, you may find the cheat sheet for part 3
useful. Feel free to contact me if you have any questions.
Liang Long
Cambridge Systematics, Inc.
4800 Hampden Lane
Suite 800
Bethesda, MD 20814
tel 301 347 0100
fax 301 347 0101
FHWA 202-366-6971
e-mail llong(a)camsys.com
www.camsys.com
This may be of interest to some.
>
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>
>
>
> ACS Data Users Conference
>
> May 29-30, 2014
> Holiday Inn Capitol, Washington D.C.
>
> Call for Abstracts!
> Deadline: January 15
> Notification Date: February 15
>
> To submit an abstract, visit www.acsdatausers.org. The $200 conference registration fee will be waived for persons presenting at the meeting.
>
> The American Community Survey (ACS) Data Users Conference will bring together ACS data users and staff from the U.S. Census Bureau to improve understanding of the value and utility of ACS data and to promote information sharing among data users about key ACS data issues and applications. The conference will include a mix of invited and contributed presentations by ACS data users and Census Bureau staff.
>
> We are inviting abstract submissions on the following topics (submissions on other applications of ACS data are also welcome):
> Using the ACS to look at trends over time, including multiyear estimates
> Issues and limitations in using small-area ACS data
> How data users have dealt with changes in ACS survey questions
> Aggregating ACS estimates and calculating margins of error
> Using ACS in GIS and other mapping applications
> How to access ACS from different sources
> Applications of ACS data in different topical areas: Health insurance and disability; Income and poverty; employment and workforce development; and Migration patterns and trends
> Please forward this announcement to others who may be interested. More information about the conference, including registration information, will be available in the coming weeks.
>
>
I downloaded the Maryland state raw data (the whole enchilada) that
Penelope was good enough to provide me. It came with documentation that
clearly explains what needs to be done but I am being hampered by the sheer
size of the dataset. It's 10 GB and that's without going into joining
tables, transposing them to meet my needs, etc. Even breaking the parts
into different databases it can't be handled in Access. I can fit Part 1
into an ESRI geodatabase but I don't have the flexibility in linking tables
that Access has.
Does anyone have any suggestions for dealing with large databases? SQL
server is one option. Are there others?
*Mara Kaminowitz, GISP*GIS Coordinator
.........................................................................
*Baltimore Metropolitan Council*
Offices @ McHenry Row
1500 Whetstone Way
Suite 300
Baltimore, MD 21230
410-732-0500 ext. 1030
mkaminowitz(a)baltometro.org
www.baltometro.org
fyi
From: ACS Data Users Group [mailto:ACS_Data_Users_Group@mail.vresp.com]
Sent: Friday, November 15, 2013 3:01 PM
To: Weinberger Penelope
Subject: Call for Abstracts: ACS Data Users Conference
[ACS data users logo]
ACS Data Users Conference
May 29-30, 2014
Holiday Inn Capitol, Washington D.C.
Call for Abstracts!
Deadline: January 15
Notification Date: February 15
To submit an abstract, visit www.acsdatausers.org.<http://cts.vresp.com/c/?PopulationReferenceB/d13a469f3e/2af176bb3e/c961d350…> The $200 conference registration fee will be waived for persons presenting at the meeting.
The American Community Survey (ACS) Data Users Conference will bring together ACS data users and staff from the U.S. Census Bureau to improve understanding of the value and utility of ACS data and to promote information sharing among data users about key ACS data issues and applications. The conference will include a mix of invited and contributed presentations by ACS data users and Census Bureau staff.
We are inviting abstract submissions on the following topics (submissions on other applications of ACS data are also welcome):
* Using the ACS to look at trends over time, including multiyear estimates
* Issues and limitations in using small-area ACS data
* How data users have dealt with changes in ACS survey questions
* Aggregating ACS estimates and calculating margins of error
* Using ACS in GIS and other mapping applications
* How to access ACS from different sources
* Applications of ACS data in different topical areas: Health insurance and disability; Income and poverty; employment and workforce development; and Migration patterns and trends
Please forward this announcement to others who may be interested. More information about the conference, including registration information, will be available in the coming weeks.
________________________________
Click to view this email in a browser<http://hosted.verticalresponse.com/1056151/d13a469f3e/521474375/2af176bb3e/>
If you no longer wish to receive these emails, please reply to this message with "Unsubscribe" in the subject line or simply click on the following link: Unsubscribe<http://cts.vresp.com/u?d13a469f3e/2af176bb3e/mlpftw>
Click here<http://oi.vresp.com/f2af/v4/send_to_friend.html?ch=d13a469f3e&lid=521474375…> to forward this email to a friend
Population Reference Bureau
1875 Connecticut Ave., NW
Suite 520
Washington, District of Columbia 20009
USA
Read<http://www.verticalresponse.com/content/pm_policy.html> the VerticalResponse marketing policy.
[Try Email Marketing with VerticalResponse!]<http://www.verticalresponse.com/landing/ef/?mm/d13a469f3e&utm_campaign=foot…>
[http://cts.vresp.com/o.gif?d13a469f3e/2af176bb3e/mlpftw]
Having an ACS or Census Long Form takes a lot of hits in media and on
Capital Hill. However, it is always instructive to hear from another
side. I snagged this from another list I am on and thought a few here
would enjoy it.
-------------------------------------
Posted: 13 Nov 2013 10:59 AM PST
by Terri Ann Lowenthal
Let me start with a timely salute to our nation’s veterans. All 21
million of them, including 2.4 million African American and 1.2 million
Hispanic former service members. Shout-outs to Killeen, Texas, and
Clarksville, Tennessee, where veterans comprise a quarter or more of
local residents. Hats off to the more than nine in ten veterans with a
high school diploma — a greater proportion than the general population.
And is it any wonder that these patriotic fellow citizens are twice as
likely as non-veterans to hold a job in public administration?
Oh, sorry, I digress from the focus of this blog. But really, people,
it’s important that we know this stuff — and more — about those who
defend our freedoms. About three-quarters of our living military
veterans served worldwide while the country was at war. More than a
quarter of both Gulf War and post-9/11 era vets live with a
service-connected disability. Nearly 30 percent of veterans reside in
rural areas, but rural vets represent 41 percent of those enrolled in
the VA health care system. Veterans in rural communities are more likely
to have at least one disability compared to non-veteran rural dwellers.
Raise your hand if you know where I’m going with this. That’s right: a
lot of what we know about our veterans comes from the Census Bureau’s
American Community Survey (ACS). Businesses, nonprofits, and federal,
state and local leaders use ACS data to understand and address the needs
of veterans — from job training and employment assistance, to health
care, to housing, and more. Who among us wouldn’t want that for our
former soldiers?
So why, oh why, in the words of Rep. Jeff Duncan (R-SC), sponsor of a
bill to cancel the ACS (and just about every other Census Bureau
program), are Americans “fed up with these mandatory census surveys and
[they’re] asking us to stop the harassment”?
Ummm, no, they’re not. Okay, maybe a few are grumbling. According to the
Census Bureau’s new cheerleader for harassed Americans (officially
called the Respondent Advocate), roughly 60 percent of households answer
the ACS without any prodding at all. With a little encouragement and
explanation, by phone or in person, the response rate jumps to 97+
percent (weighted). Of the 3.54 million households in the 2012 ACS
sample, less than 8,000 refused to participate (and no one, I can assure
you, was hauled off to jail). Let’s see: that’s a refusal rate of
(drumroll) two-tenths of a percent. The 535 members of Congress were so
deluged with anti-ACS complaints that they sent the bureau (another
drumroll, please) 187 letters on behalf of distraught constituents over
the past 18 months.
Sure, the ACS questions could use a systematic review and some
fine-tuning; thorough training will help ensure positive interaction
between survey takers and responding householders. I suspect the Census
Bureau has been a little behind the eight ball in acknowledging
thoughtful concerns about parts of the survey; it’s finally on the right
track, I think. More on these efforts in my next blog.
But let’s stop pretending: ACS critics aren’t falling on their data
swords for countless (no pun intended, census fans!) Americans abiding
stoically in the shadow of government overreach. Ideology — namely, a
belief that government can require little of the governed, coupled with
an aversion to the sort of federal assistance dispensed on the basis of
ACS data — is driving the campaign to weaken (with voluntary response)
or eliminate the survey.
And that’s okay. (Yes, you read that correctly.) If you don’t believe
that government has a fundamental interest in producing objective,
comprehensive data to inform and guide decision-making, go ahead and
make your case. Explain and defend the consequences or propose a
practical alternative. Just please drop the cover of phantom citizens
cowering behind mailboxes, dreading a nosy questionnaire and the
prospect of devoting an hour of time to help the world’s greatest
democracy function smartly. Most Americans, it seems, are wiser than you
think. And they all love our veterans.
--
Ed Christopher
Hi All,
Based on your experiences with the 20/20 software so far, what would be the best (meaning fastest) way to obtain a TAZ-TAZ O/D matrix for all TAZ's in Weber, Davis, Salt Lake and Utah Counties. I want all trips originating and ending in those 4 counties.
Anyone care to put forward the fastest way of doing a query such as this?
Ultimately, I will be processing the data for all metro regions in matlab or python, so it would be great if the data came in a 4 column table: origin, destination, flow, MOE.
For the 2000 data, I used to just download the flat files state by state. Is this option no longer available for the 5-year ACS data?
Many thanks,
Steve
Steven Farber, Ph.D
Assistant Professor
Department of Geography
University or Utah
http://stevenfarber.wordpress.com
Hi All,
We have made an adjustment on the new CTPP 5-year data access software so that un-customized (no special groups or percentages applied) tables now have a 500,000 cell download limit (up from 100,000) this should make it much easier to get your bigger area or more flow tables!
The new software and tutorials are available at: http://ctpp.transportation.org/Pages/5-Year-Data.aspx
And please read the info and caveats at: http://ctpp.transportation.org/Pages/5-Year-Info.aspx
Penelope Z. Weinberger
CTPP Program Manager
AASHTO
202-624-3556
ctpp.transportation.org
At long last the CTPP 5 year small area data is (a)live and can be accessed by clicking take me to the data at the following URL: http://ctpp.transportation.org/Pages/5-Year-Data.aspx
A tutorial that shows the software's functionality is available at: http://ctpp.transportation.org/Documents/CTPP_tutorial_v02.pdf
Web tutorials are available at: http://www.youtube.com/user/CTPPProgram
Please see the message below for more information and known issues.
From: Weinberger Penelope
Sent: Wednesday, October 30, 2013 5:27 PM
To: ctpp-news(a)chrispy.net
Subject: CTPP 5-year data
The CTPP 5-year data, based on ACS 2006 - 2010 Census Data, will be released tomorrow Thursday, October 31, 2013, the URL to access the data will be published here.
The CTPP Data Access Software is a powerful tool to access the nearly 350 gigs of data provided by the Census Bureau. The Data set consists of almost 200 residence based tables, 115 workplace based tables and 39 flow tables (Home to work) for over 325,000 geographies. The data are derived from two American Community Survey microdata record sets based on the 2006 - 2010 ACS. One set is the original microdata; all tables derived from this set are designated A, the other set is a disclosure proofed microdata set; all tables derived from this set are designated B. That is to say, the first letter in the table name indicates the set from which the table was derived. For more information on disclosure proofing, please access the CTPP e-Learning module "Disclosure Proofing" at: http://ctpp.training.transportation.org/
The software contains a robust map tool, for both selecting geography and rendering results. Results can also be presented as various style charts and tables that can be rearranged to suit your analysis and display needs. Data from the tool can be downloaded as comma or semi colon delimited .csv, .xml, .shp, .tab.
Some things to be aware of:
This is a new software release and it is possible you may find some errors and bugs as you use it. Please use the CTPP Feedback form available in the Help menu to report any problems encountered. (Version 1.1 release, already planned for the near future, reflects corrections to issues discovered after Beta testing.) Please consider this a Gamma version.
A PDF tutorial is available in the Help menu and covers much of the software functionality teaching a sample application. The context sensitive (on-line) help has some bugs that are currently being addressed. A series of short film tutorials is available on the CTPP YouTube channel at: http://www.youtube.com/user/CTPPProgram. The YouTube tutorials include a software tour, how to register/logon, opening and rearranging a table/accessing basic data; Geography selection by list and map; Calculating percentages; and Display maps and thematic analyses. If, after you have exhausted all resources you are still having trouble please contact pweinberger(a)aashto.org<mailto:pweinberger@aashto.org> for a walk through, but please try to find your solution from available resources first. Training is rolling out both in person and online, we will keep you posted.
Downloads are limited to 100,000 cells. If you need to download large tables they will need to be split up and stitched back together in excel (or another program). We are developing a background downloader for large files. In the meantime, if you simply want all the data for your entire area, send a message to pweinberger(a)aashto.org<mailto:pweinberger@aashto.org> and a set with appropriate documentation will be made available for FTP download. Any very large data set is unsupported and for power users, comfortable manipulating large data sets in statistical software packages that they are already licensed to use.
Geographies can be aggregated and margins of error will be correctly re-calculated, but non-standard (user created) saved geographies cannot be mapped - we are working on this.
Until approximately January 2014, the data set available does not include workplace data for TAZs with zero (0) populations. This means that any TAZ which consists solely of a special generator (i.e., an airport, a shopping mall, a business park, the pentagon, etc.) does not have its associated workplace data or flow to it available. This is being rectified and a new dataset will be released around January, 2014 that corrects that problem. Fortunately, the data is available at tract even for zero pop tracts, so you can get the data at smallish, just not smallest, level and you can do TAZ to Tract flows
Penelope Z. Weinberger
CTPP Program Manager
AASHTO
202-624-3556
ctpp.transportation.org
From: Weinberger Penelope
Sent: Thursday, October 31, 2013 4:41 PM
To: ctpp-news(a)chrispy.net
Subject: It's Alive! CTPP 5-year data
At long last the CTPP 5 year small area data is (a)live and can be accessed by clicking take me to the data at the following URL: http://ctpp.transportation.org/Pages/5-Year-Data.aspx
A tutorial that shows the software's functionality is available at: http://ctpp.transportation.org/Documents/CTPP_tutorial_v02.pdf
Web tutorials are available at: http://www.youtube.com/user/CTPPProgram
Please see the message below for more information and known issues.
From: Weinberger Penelope
Sent: Wednesday, October 30, 2013 5:27 PM
To: ctpp-news(a)chrispy.net<mailto:ctpp-news@chrispy.net>
Subject: CTPP 5-year data
The CTPP 5-year data, based on ACS 2006 - 2010 Census Data, will be released tomorrow Thursday, October 31, 2013, the URL to access the data will be published here.
The CTPP Data Access Software is a powerful tool to access the nearly 350 gigs of data provided by the Census Bureau. The Data set consists of almost 200 residence based tables, 115 workplace based tables and 39 flow tables (Home to work) for over 325,000 geographies. The data are derived from two American Community Survey microdata record sets based on the 2006 - 2010 ACS. One set is the original microdata; all tables derived from this set are designated A, the other set is a disclosure proofed microdata set; all tables derived from this set are designated B. That is to say, the first letter in the table name indicates the set from which the table was derived. For more information on disclosure proofing, please access the CTPP e-Learning module "Disclosure Proofing" at: http://ctpp.training.transportation.org/
The software contains a robust map tool, for both selecting geography and rendering results. Results can also be presented as various style charts and tables that can be rearranged to suit your analysis and display needs. Data from the tool can be downloaded as comma or semi colon delimited .csv, .xml, .shp, .tab.
Some things to be aware of:
This is a new software release and it is possible you may find some errors and bugs as you use it. Please use the CTPP Feedback form available in the Help menu to report any problems encountered. (Version 1.1 release, already planned for the near future, reflects corrections to issues discovered after Beta testing.) Please consider this a Gamma version.
A PDF tutorial is available in the Help menu and covers much of the software functionality teaching a sample application. The context sensitive (on-line) help has some bugs that are currently being addressed. A series of short film tutorials is available on the CTPP YouTube channel at: http://www.youtube.com/user/CTPPProgram. The YouTube tutorials include a software tour, how to register/logon, opening and rearranging a table/accessing basic data; Geography selection by list and map; Calculating percentages; and Display maps and thematic analyses. If, after you have exhausted all resources you are still having trouble please contact pweinberger(a)aashto.org<mailto:pweinberger@aashto.org> for a walk through, but please try to find your solution from available resources first. Training is rolling out both in person and online, we will keep you posted.
Downloads are limited to 100,000 cells. If you need to download large tables they will need to be split up and stitched back together in excel (or another program). We are developing a background downloader for large files. In the meantime, if you simply want all the data for your entire area, send a message to pweinberger(a)aashto.org<mailto:pweinberger@aashto.org> and a set with appropriate documentation will be made available for FTP download. Any very large data set is unsupported and for power users, comfortable manipulating large data sets in statistical software packages that they are already licensed to use.
Geographies can be aggregated and margins of error will be correctly re-calculated, but non-standard (user created) saved geographies cannot be mapped - we are working on this.
Until approximately January 2014, the data set available does not include workplace data for TAZs with zero (0) populations. This means that any TAZ which consists solely of a special generator (i.e., an airport, a shopping mall, a business park, the pentagon, etc.) does not have its associated workplace data or flow to it available. This is being rectified and a new dataset will be released around January, 2014 that corrects that problem. Fortunately, the data is available at tract even for zero pop tracts, so you can get the data at smallish, just not smallest, level and you can do TAZ to Tract flows
Penelope Z. Weinberger
CTPP Program Manager
AASHTO
202-624-3556
ctpp.transportation.org
The CTPP 5-year data, based on ACS 2006 - 2010 Census Data, will be released tomorrow Thursday, October 31, 2013, the URL to access the data will be published here.
The CTPP Data Access Software is a powerful tool to access the nearly 350 gigs of data provided by the Census Bureau. The Data set consists of nearly 200 residence based tables, 115 workplace based tables and 39 flow tables (Home to work) for over 200,000 geographies. The data are derived from two American Community Survey microdata record sets based on the 2006 - 2010 ACS. One set is the original microdata; all tables derived from this set are designated A, the other set is a disclosure proofed microdata set; all tables derived from this set are designated B. That is to say, the first letter in the table name indicates the set from which the table was derived. For more information on disclosure proofing, please access the CTPP e-Learning module "Disclosure Proofing" at: http://ctpp.training.transportation.org/
The software contains a robust map tool, for both selecting geography and rendering results. Results can also be presented as various style charts and tables that can be rearranged to suit your analysis and display needs. Data from the tool can be downloaded as comma or semi colon delimited .csv, .xml, .shp, .tab.
Some things to be aware of:
This is a new software release and it is possible you may find some errors and bugs as you use it. Please use the CTPP Feedback form available in the Help menu to report any problems encountered. (Version 1.1 release, already planned for the near future, reflects corrections to issues discovered after Beta testing.) Please consider this a Gamma version.
A PDF tutorial is available in the Help menu and covers much of the software functionality teaching a sample application. The context sensitive (on-line) help has some bugs that are currently being addressed. A series of short film tutorials is available on the CTPP YouTube channel at: http://www.youtube.com/user/CTPPProgram. The YouTube tutorials include a software tour, how to register/logon, opening and rearranging a table/accessing basic data; Geography selection by list and map; Calculating percentages; and Display maps and thematic analyses. If, after you have exhausted all resources you are still having trouble please contact pweinberger(a)aashto.org<mailto:pweinberger@aashto.org> for a walk through, but please try to find your solution from available resources first. Training is rolling out both in person and online, we will keep you posted.
Downloads are limited to 100,000 cells. If you need to download large tables they will need to be split up and stitched back together in excel (or another program). We are developing a background downloader for large files. In the meantime, if you simply want all the data for your entire area, send a message to pweinberger(a)aashto.org<mailto:pweinberger@aashto.org> and a set with appropriate documentation will be made available for FTP download. Any very large data set is unsupported and for power users, comfortable manipulating large data sets in statistical software packages that they are already licensed to use.
Geographies can be aggregated and margins of error will be correctly re-calculated, but non-standard (user created) saved geographies cannot be mapped - we are working on this.
Until approximately January 2014, the data set available does not include workplace data for TAZs with zero (0) populations. This means that any TAZ which consists solely of a special generator (i.e., an airport, a shopping mall, a business park, the pentagon, etc.) does not have its associated workplace data or flow to it available. This is being rectified and a new dataset will be released around January, 2014 that corrects that problem. Fortunately, the data is available at tract even for zero pop tracts, so you can get the data at smallish, just not smallest, level and you can do TAZ to Tract flows
Penelope Z. Weinberger
CTPP Program Manager
AASHTO
202-624-3556
ctpp.transportation.org
