Introduction to Spatial Data

1. Part 1: Introduction to GIS and ESRI
   1. Background: Geographical information in the U.S.
   2. Hello Map: Thematic Mapping and the basics
      • Connecting a folder
      • Adding Layers
      • Setting the projection
      • Attributes
      • Symbolization
      • Labeling
      • Choropleth Maps
2. Part 2: Working with Social Explorer
   1. Data, data, data!
   2. Acquiring data
   3. Import the data into ArcMap
   4. The leading zero nightmare…
   5. Joining data

Part I: Introduction to GIS and ESRI

The ESRI way of GIS

The first step in this tutorial is to understand that we are covering the basics of desktop GIS analysis using ESRI’s ArcGIS software suite. This is by no means an all encompassing “entirety of GIS” tutorial, but rather a view on how GIS is used to build maps from ESRI’s perspective, limited by the functionalities of the software covered.

The core function of the ESRI ArcGIS suite lies within two programs:

1. ArcCatalog – for managing GIS datasets
2. ArcMap – for mapping GIS datasets

[TBS_ALERT color=”info” heading=”What about OpenSource Alternatives?”]

QGIS is as an alternative to ArcGIS that is free and openly available to the public on all computing platforms. Despite the accessibility of QGIS, there is a steeper learning curve for those learning GIS for the first time. However, those seeking a free low-cost alternative to ArcGIS can apply the concepts learned in this workshop with that program.

For those interested in seeing the comparison between QGIS and ArcGIS you can check out this external article here: http://www.xyht.com/spatial-itgis/qgis-v-arcgis/

[/TBS_ALERT]

A little background: Geographical information in the U.S.A.

Demographic information in the USA is typically arranged in a hierarchical geography, starting from large to small. Starting from States, information gets broken down into Counties or Metropolitan Statistical Areas (MSAs). Each of those are comprised of Census Places which are similar to cities in their size and composition. The neighborhoods of each city are broken down into a Census Tract. Census Tracts are then subdivided further into Census Block Groups. Finally, Census Block Groups compose of Census Blocks, but data is not usually published at this level for privacy concerns.

 

[TBS_ALERT color=”info” heading=””]In short US geography is organized like this:

States → Counties / Metropolitan Statistical Areas → Census Places → Census Tract → Census Block Group → Census Block

[/TBS_ALERT]

Basics of Thematic Mapping

With geographical ideas in mind, now it is finally time to map something! For this exercise, you are provided with a Workshop [simple_tooltip content=’A geodatabase is shown as a folder. ‘]geodatabase[/simple_tooltip], which is a collection of GIS datasets. A GIS dataset can be any of the following:

1. a vector layer – points, lines or polygons
2. a raster layer – an image, Satellite imagery, elevation data
3. tabular data – excel spreadsheet, csv, etc.

[TBS_ALERT color=”info” heading=”Vector vs. Rasters”]Geographic data is stored either as vector data (as points, lines, or polygons) or raster data (as pixel grids).

Because of these differences in data storage, vector data is best suited for a human geography context (ex. urban planning, transportation forecasting, asset mapping), while raster data are best used for storing data on physical geography (ex. satellite imagery, elevation, watersheds, vegetation).

In ArcGIS, vector data is stored as individual .shp files (or feature classes within a geodatabase), while raster data is stored as .tiffs, .jpgs, or other image formats. [/TBS_ALERT]

In other words, our geodatabase contains one or multiple GIS datasets.

• UCLA Geoportal
• Backup workshop Data Download Link

Download and [simple_tooltip content=’Extracting means using a program, such as 7zip to unzip files from a single file.’]extract[/simple_tooltip] Workshop.zip.

Then locate Workshop.gdb, and put it in a project folder for this workshop. You will learn how to inspect the geodatabase data in ArcCatalog, then use ArcMap to create some maps.

Here is a look at our Workshop geodatabase:

Workshop.gdb
|--us_cities
|--us_counties
|--us_states

Connecting a folder in ArcCatalog

Open up ArcCatalog and click the second button to left, which is the “Connect Folder” button.

Navigate to the Folder where you extracted the “Workshop.zip” file and then select “OK”.

[TBS_ALERT color=”danger” heading=”Do not try to connect a file!”]If you try to connect files, you will notice that the “OK” button is grayed out, connecting folders allows you only to choose folders.[/TBS_ALERT]

View and Preview the data

After you’ve connected the folder, now you can check Folder Connections and open the Folder which you’ve connected.

Locate “Workshop.gdb” and double click it to view its contents.

Browse for us_states and click the “Preview” tab.

Setting up your project

Through the process of this workshop, you will be creating many new data layers. It is always good practice to designate a path to the geodatabase that you will use to store the layers.

1. Go to File, Map Document Properties…
2. Change the default geodatabase by finding the path to the workshop geodatabase you just downloaded.
3. Also click on the checkbox next to Store relative pathnames to data sources
   

Adding Layers

Now the time has come to fire up ArcMap and get to map making!

The first step for any GIS project is to have data (more on this later!). In order to add data to your project click on the “Add data” button:

Notice how the connected folder can be selected and datasets be added now? Also, if your map is feeling a bit empty, you can add base maps by clicking the upside down triangle next to the Add Data button. Adding a basemap only provides reference information and nothing else.

[TBS_ALERT color=”info” heading=”ArcCatalog in ArcMap?”] You can also connect folders in ArcMap by clicking a button, but we didn’t do so because we wanted to demo ArcCatalog. You can even access ArcCatalog in ArcMap, but the view is rather constrained, so we opted to demo the standalone program.[/TBS_ALERT]

Setting the projection

The datasets provided in this workshop are in a geographic coordinate system (GCS_WGS_1984). By default, the project thus assumes a “flat” view of the earth, intended to support datasets for the entire world. Given that we are only working with US based data, we can choose to visualize our maps with a more “US-centric” perspective. Let’s set our projection with this in mind:

1. Right click on “Layers” and go to “properties”
2. Select the “coordinate systems” tab
3. Go to “Projected Coordinate Systems”, “Continental”, “North America”, and choose “USA Contiguous Albers Equal Area Conic USGS”

[TBS_ALERT color=”danger” heading=”It’s on the fly!”]The software will warn you that you are projecting your datasets on the fly (note that it is not reprojecting the actual data, it is doing so only within the scope of this project space). If you want to perform spatial analysis, it is recommended that all layers in your project be reprojected to an appropriate coordinate system. More information on how to do this can be found here.[/TBS_ALERT]

Order your layers

Vector layers are also referred to as “feature classes” in ESRILand. All GIS datasets can be added in this same way. Now drag each layer and re-order them. If you are familiar with Adobe Photoshop or Illustrator, you will recognize conceptual similarities with layering. What happens when layers are re-ordered? How does this dictate your strategy on building a single flattened map with multiple layers?

[TBS_ALERT color=”info” heading=”Challenge Exercise”]Modify your map by changing fill colors, outline colors, symbol sizes, symbol colors to make it look like this:

[/TBS_ALERT]

Attributes

Every layer (feature class) comes with attributes. This is the all-important “information” part of geographic “information” systems mapping. Data in the attribute tables dictates what can get mapped. Open the attribute table of each layer, and study how each row and column is tied to the mapped element. Questions we will answer include:

• What is the unique identifier for each row?
• What other attributes exist?
• What happens when you select a row on the attribute table?
• How do you sort elements?
• Can you build custom queries?
• Can you build graphs?

Symbolization

Outlines, fills, colors, weight, action! Here is the design phase of creating a map. Consider color choices: grayscale? color schemes? color hierarchy? Inevitably, you will find yourselves in the throes of ESRI’s symbolization quagmire… That said, experiment with two types of symbolization with the workshop data:

1. Categories -> Unique values
2. Quantities -> Graduated colors

Labeling

Map elements need labels at times. Consider what needs to be labeled, and what does not. Label sizes, fonts, weights, placement, colors are all things to consider for your map. Understand the relationship between labels, attributes, and layers.

[TBS_ALERT color=”info” heading=”Labels hard to read? Halo it!”]Sometimes your labels may be hard to read, depending on what resides in the background. In this situation, you can add a white “halo” to your labels to make them “pop” some more. This feature is very, very hidden in ArcMap, but here is how to get to it:

1. Go the Label tab
2. Click “Symbol“
3. Click “Edit symbol“
4. Click “Mask“
5. Choose “Halo“

[/TBS_ALERT]

Choropleth Maps

For this section, we will focus on creating a choropleth (which just means a colored map based on numerical data)!

When creating a choropleth the following needs to be considered:

1. Is the data choropleth-able?
   1. Choropleths work best when representing data where boundaries are important
   2. Conversely, choropleths do not work well when attempting to show data where boundaries are NOT important/irrelevant
2. Do you have the data in the geographic scale you wish to map it at?
3. Can you connect the data to an existing layer?
4. Which coloring style best represents your data?
   1. If your information is continuous then use a single color gradient
   2. If your information has a positive or negative range, use an opposite color scheme

Part 2: Working with Social Explorer

Data, data, data!

Let’s talk about data manipulation in ArcMap, which is one of the core functions of any GIS program. Within ArcMap “joining” or “connecting” data is a fundamental task for working between data from different sources. There are two basic “joining” method available:

1. Joining – connecting an external data source to a GIS dataset
2. Spatial Join – connecting data based on geography

This workshop will focus on the first “joining” method, which is more applicable to non-geographic datasets, such as excel spreadsheets, CSVs, and other data tables.

Acquiring data

Social Explorer provides data for the entire US Census (1790 to 2010) and the American Community Survey (2005 to 2015).

[TBS_ALERT color=”info” heading=”Check this out!”]For a more detailed workshop on using Social Explorer, visit this page.[/TBS_ALERT]

Let’s download employment data from Social Explorer:

1. Go to Social Explorer and click on the “Tables” tab
2. Select “American Community Survey (5-Year Estimates)”
3. Click on “Begin Report” for the newest survey
4. Select “County” for geographic type, highlight “All counties” and click the “Add” button, and then click on “Proceed to Tables”
   
5. For this workshop, we are interested in the following parameters. From the list of table, choose the following tables (command/ctrl click to select multiple tables):
   1. T4: Sex
   2. T7: Age
   3. T13: Race
   4. T150: Highest Educational Attainment
   5. T33: Employment Status
   6. T37: Unemployment Rate
   7. T57: Median Household Income
      
6. Once selected, click on the Add button and Show results
   
7. Click on the Data Download tab and download the following two files:
   1. County data (CSV)
   2. Data dictionary (text file)
   3. Save the county data as acs2016_county.csv
      
      

Import the data into ArcMap

Let’s import our table into ArcMap.

1. Click on the add data button and import the  acs2016_county.csv table
2. Right click on the table (from the left panel table of contents) and click on “open” (or use the CTRL-T shortcut)
3. Let’s add this table to our workshop geodatabase. Right click on the table, click “Data“, and “Export“
4. Click on the yellow folder button, navigate to your “workshop.gdb” geodatabase, and save the table as “acs2016_county“. Choose “yes” to add it to your project.
5. Right click on acs2016_county.csv and remove it from your project

The leading zero nightmare…

Open the attribute table for your acs2016_county table. Notice the column Geo_FIPS. The first record is for Autauga County in Alabama. The Geo_FIPS is “1001”. However, the “real” FIPS code for Autauga County is “01001” (with a leading “0”). Arc interprets the column as numeric, and therefore crops any leading zeroes in the column. This poses a problem when we need to use this column to join the data to another layer with the same FIPS code. The following python code fixes this problem by creating a new column and adding the leading zeroes:

1. Click on the table menu button, and click “Add Field…”
   
2. Name the new field “FIPS“, type “Text“, and Length “5”
   
3. In the table view, right click on the new column header (you will have to scroll all the way to the right), and click “Field Calculator”
   
4. In the field calculator, choose the “Python” parser, and enter the following formula:str( !Geo_FIPS! ).zfill(5)Click OK and double check that your FIPS column does indeed have leading zero’s.

Joining data

Now we are ready to join our employment data to our county layer.

1. Right click on “us_counties“, “Joins and relates“, “Join…”
   
2. Choose “FIPS” as the field to join, select the “acs2016_county” table, and also choose “FIPS” to base the join on.
   
3. Right click on “us_counties” and go to “Properties“, “Symbology“, “Quantities“. Now… remember the Data Dictionary you downloaded from Social Explorer? Here is where it comes handy, as the data fields are not descriptive. Open the data dictionary in a text editor. What is the corresponding column name for the unemployment rate?
4. Let’s map the nation’s unemployment rate. For “Value“, select “Unemployed“, or “SE_T037_003“.
5. Let’s also normalize the data by the employable population. For “Normalization“, select “Civilian Population in Labor Force 16 Years and Over“, or “SE_T037_001”
   
6. The employment rate in December 2017 is at 4.1%. Let’s build a map that will visually reflects this rate.
7.  Click on the “Classify” button
8. Select “Manual“
9. In the “Break Values” box, enter the following breaks: 0.04, 0.08, 0.12, 0.16
   
10. Click OK. Back in the layer property screen, choose a color ramp that goes from “cold” to “hot”. Red colors should generally be used to symbolize problem areas, so flip the colors if necessary (right click on the header “Symbol“).
11. In the “Label” column, label each symbol as follows:
    

[TBS_ALERT color=”info” heading=”You are done!”]Your final map should look like this:

 

[/TBS_ALERT]

Assignment

Choose a topic of interest that can be visualized as a county based US map from data that is available on Social Explorer. Download your data of choice from Social Explorer, join it to the county layer provided in this workshop, and symbolize it to create a choropleth map. Add a short paragraph description that describes the map.

[TBS_ALERT color=”danger” heading=”Submit your map!”]Post your map on this Google Doc. Add a title, your name, your map image, and your paragraph.[/TBS_ALERT]