The first step in this tutorial is to understand that we are covering the basics of desktop GIS analysis using ESRI’s ArcGIS software suite. This is by no means an all encompassing “entirety of GIS” tutorial, but rather a view on how GIS can be used to build maps from ESRI’s perspective, limited by the functionalities of the software being covered. There are many other tools you may want to consider to do your spatial analysis, including R, Python, Carto, Mapbox, D3, and qGIS.
The core function of the ESRI ArcGIS suite lies within two programs:
ArcCatalog – for managing GIS datasets
ArcMap – for mapping GIS datasets
[TBS_ALERT color=”info” heading=”What about OpenSource alternatives?”]
QGIS is as an alternative to ArcGIS that is free and openly available to the public on all computing platforms. Despite the accessibility of QGIS, there is a steeper learning curve for those learning GIS for the first time. However, those seeking a free low-cost alternative to ArcGIS can apply the concepts learned in this workshop with that program.
[/TBS_ALERT]
Hello Map
With geographical ideas in mind, it is finally time to map something! For this exercise, you are provided with a Workshop [simple_tooltip content=’A geodatabase is shown as a folder. ‘]geodatabase[/simple_tooltip], which is a collection of GIS datasets. A GIS dataset can be any of the following:
a vector layer – points, lines or polygons
a raster layer – an image, Satellite imagery, elevation data
tabular data – excel spreadsheet, csv, etc.
[TBS_ALERT color=”info” heading=”Vector vs. Rasters”]Geographic data is stored either as vector data (as points, lines, or polygons) or raster data (as pixel grids).
Because of these differences in data storage, vector data is best suited for a human geography context (ex. urban planning, transportation forecasting, asset mapping), while raster data are best used for storing data on physical geography (ex. satellite imagery, elevation, watersheds, vegetation).
In ArcGIS, vector data is stored as individual .shp files or feature classes within a geodatabase. Raster data is stored as .tiffs, .jpgs, or other image formats. [/TBS_ALERT]
Download and [simple_tooltip content=’Extracting means using a program, such as 7zip to unzip files from a single file.’]extract[/simple_tooltip] Workshop.zip. Locate Workshop.gdb, and put it in a project folder for this workshop. You will learn how to inspect the geodatabase data in ArcCatalog, then use ArcMap to create some maps.
Open up ArcCatalog and click the second button to the left, which is the “Connect Folder” button.
Navigate to the Folder where you extracted the “workshopData2018.zip” file and then select “OK”.
[TBS_ALERT color=”danger” heading=”Do not try to connect a file!”]If you try to connect files, you will notice that the “OK” button is grayed out, connecting folders allows you only to choose folders.[/TBS_ALERT]
View and Preview the data
After you’ve connected the folder, you can check Folder Connections and open the Folder which you’ve connected. Locate “workshop2018.gdb” and double click it to view its contents. Browse for us_states and click the “Preview” tab.
Hello Egypt: Setting the projection
Geographic coordinate systems are typically measured in decimal degrees, and are useful when your data is global and/or comes with latitude and longitude coordinates. However, because of its angular units, it is not recommended for spatial analysis. Instead, one should consider using a projected coordinate system that is suited to the region of analysis. Given that we are only working with Egypt based data, let’s set our projection to the following UTM zone that is specifically optimized for our region of interest:
WGS 1984 UTM Zone 36N
Let’s set our projection with this in mind:
Right click on “Layers” and go to “properties” (or just double click on “Layers”)
Select the “Coordinate Systems” tab
Go to “Projected Coordinate Systems“, “UTM“, “WGS 1984“, “Northern Hemisphere“, and choose “WGS 1984 UTM Zone 36N“
[TBS_ALERT color=”danger” heading=”It’s on the fly!”]The software will warn you that you are projecting your datasets on the fly (note that it is not reprojecting the actual data, it is doing so only within the scope of this project space). If you want to perform spatial analysis, it is recommended that all layers in your project be reprojected to an appropriate coordinate system. More information on how to do this can be found here.[/TBS_ALERT]
Adding Layers
Now the time has come to fire up ArcMap and become a digital cartographer! The first step for any GIS project is to have data (more on this later). In order to add data to your project click on the “Add data” button:
Notice how the connected folder can be selected and datasets be added now? Also, if your map is feeling a bit empty, you can add base maps by clicking the upside down triangle next to the Add Data button. Adding a basemap only provides reference information and nothing else.
Order your layers
Vector layers are also referred to as “feature classes” in ESRI-Land. All GIS datasets can be added in this same way. Now drag each layer and re-order them. If you are familiar with Adobe Photoshop or Illustrator, you will recognize conceptual similarities with layering. What happens when layers are re-ordered? How does this dictate your strategy on building a single flattened map with multiple layers?
[TBS_ALERT color=”info” heading=”Challenge Exercise”]Modify your map by changing fill colors, outline colors, symbol sizes, symbol colors to make it look like this:
[/TBS_ALERT]
Symbolization
Outlines, fills, colors, weight, action! Here is where the artist in you comes out and the design phase of creating a map begins. Consider color choices: grayscale? Color schemes? Color hierarchy? Inevitably, you will find yourselves in the throes of ESRI’s symbolization quagmire…
Labeling
Map elements need labels at times. Consider what needs to be labeled, and what does not. Label sizes, fonts, weights, placement, colors are all things to consider for your map. Understand the relationship between labels, attributes, and layers.
[TBS_ALERT color=”info” heading=”Labels hard to read? Halo it!”]Sometimes your labels may be hard to read, depending on what resides in the background. In this situation, you can add a white “halo” to your labels to make them “pop” some more. This feature is very, very hidden in ArcMap, but here is how to get to it:
Go the Label tab
Click “Symbol“
Click “Edit symbol“
Click “Mask“
Choose “Halo“
[/TBS_ALERT]
Attributes
Every layer (feature class) comes with attributes. This is the all-important “information” part of geographic “information” systems mapping. Data in the attribute tables dictates what can get mapped. Open the attribute table of each layer (right click on the layer from the table of contents, Open Attribute Table):
Study how each row and column is tied to the mapped element. Questions we will answer include:
What is the unique identifier for each row?
What other attributes exist?
What happens when you select a row on the attribute table?
How do you sort elements?
Can you build custom queries?
Can you build graphs?
Choropleth Maps
For this section, we will focus on creating a choropleth (which just means a colored map based on numerical data)!
When creating a choropleth the following needs to be considered:
Is the data choropleth-able?
Choropleths work best when representing data where boundaries are important
Conversely, choropleths do not work well when attempting to show data where boundaries are NOT important/irrelevant
Do you have the data in the geographic scale you wish to map it at?
Can you connect the data to an existing layer?
Which coloring style best represents your data?
If your information is continuous then use a single color gradient
If your information has a positive or negative range, use an opposite color scheme
To create a choropleth map, follow these steps:
Right click on us_counties and go to properties (or just double click it!)
Select the Symbology tab, click on Quantities, and select POP2010 for the Value field.
Now click on the Classify button. There are several methods to choose from. Look at the following documentation to determine which method is best suited for your data.
Part 2: Working with spatial data
Acquiring data
The open data movement has made more and more data available for academics to download and use for their research. But how can we map this data? This workshop will take you through the process of acquiring data from the Los Angeles Open Data portal and visualizing it on ArcGIS for further analysis. Los Angeles Open Data portal
The Los Angeles Open Data Portal
Search for crime data
Inspect the data
Almost 2 million records! Let’s filter it down to something more manageable.
Now add the filter to narrow down the data to one month:
Export the data
Cleaning up those coordinates
Open the downloaded data in Excel. Scroll to the right until you see the Location column.
Hmm, that’s strange, the latitude and longitude columns are in the same column! ArcGIS does not like this. Let’s clean this up.
First, find and replace the brackets.
Select the Location column
Bring up the find and replace tool (ctrl-h)
For “Find what”, enter an open bracket “(“
Click Replace All
Repeat for the closing bracket.
Split the column into two:
Choose, delimited, check the “Comma” box, and finish.
Rename the column headers to Latitude and Longitude
Let’s map it!
Start a brand new ArcMap project and add the csv file (remember the Add Data button?). Right click on the csv file and Display XY Data.
Set X to Longitude
Set Y to Latitude
Click Edit for the coordinate system
Enter “WGS 1984” in the search box
Choose WGS 1984
Now save your new layer as a shapefile, or geodatabase:
Project the data
Our data is currently in a geographic coordinate system (WGS1984). Let’s change this to a projected coordinate system. The UTM zone for Los Angeles is UTM Zone 11N.
Click on the search tool
Type “project” and click on Project (Data Management)
Now, set the projection of the data frame. Right click on Layers, and go to properties. Then, set the coordinate system to NAD 1983 UTM Zone 11N
Hot spots?
Let’s find crime hot spots by race. Select incidents where the person arrested was classified as Hispanic (H). In the menu bar, go to Selection, Select by attribute. Enter the following SQL statement:
Victim_Decent = ‘H’
Now perform a kernel density to visualize the density of Hispanic arrests in Los Angeles. In the search box, enter “kernel” and click on the Kernel Density (Spatial Analyst) tool. Enter the four boxes as shown below:
Add a basemap, and change the symbology to make the visual more powerful:
[TBS_ALERT color=”info” heading=”Pre-class poll”]Welcome! Before we begin our adventure on “spatial thinking,” please take a minute to take this poll.
Pre-workshop poll
(password: “ucla”)
Bonus: Poll Results | Batch geocoder
After the workshop, please take this survey:
Post-workshop survey
[/TBS_ALERT]
Part 1: Introduction to GIS and ESRI
Part 2: Working with spatial data
Part I: Introduction to GIS and ESRI
Gettin’ down and dirty with ESRI
The first step in this tutorial is to understand that we are covering the basics of desktop GIS analysis using ESRI’s ArcGIS software suite. This is by no means an all encompassing “entirety of GIS” tutorial, but rather a view on how GIS can be used to build maps from ESRI’s perspective, limited by the functionalities of the software being covered. There are many other tools you may want to consider to do your spatial analysis, including R, Python, Carto, Mapbox, D3, and qGIS.
The core function of the ESRI ArcGIS suite lies within two programs:
[TBS_ALERT color=”info” heading=”What about OpenSource alternatives?”]
QGIS is as an alternative to ArcGIS that is free and openly available to the public on all computing platforms. Despite the accessibility of QGIS, there is a steeper learning curve for those learning GIS for the first time. However, those seeking a free low-cost alternative to ArcGIS can apply the concepts learned in this workshop with that program.
[/TBS_ALERT]
Hello Map
With geographical ideas in mind, it is finally time to map something! For this exercise, you are provided with a Workshop [simple_tooltip content=’A geodatabase is shown as a folder. ‘]geodatabase[/simple_tooltip], which is a collection of GIS datasets. A GIS dataset can be any of the following:
[TBS_ALERT color=”info” heading=”Vector vs. Rasters”]Geographic data is stored either as vector data (as points, lines, or polygons) or raster data (as pixel grids).
Because of these differences in data storage, vector data is best suited for a human geography context (ex. urban planning, transportation forecasting, asset mapping), while raster data are best used for storing data on physical geography (ex. satellite imagery, elevation, watersheds, vegetation).
In ArcGIS, vector data is stored as individual .shp files or feature classes within a geodatabase. Raster data is stored as .tiffs, .jpgs, or other image formats. [/TBS_ALERT]
Our geodatabase contains multiple GIS feature classes.
Download and [simple_tooltip content=’Extracting means using a program, such as 7zip to unzip files from a single file.’]extract[/simple_tooltip] Workshop.zip. Locate Workshop.gdb, and put it in a project folder for this workshop. You will learn how to inspect the geodatabase data in ArcCatalog, then use ArcMap to create some maps.
Here is a look at our Workshop geodatabase:
Connecting a folder in ArcCatalog
Open up ArcCatalog and click the second button to the left, which is the “Connect Folder” button.
Navigate to the Folder where you extracted the “workshopData2018.zip” file and then select “OK”.
[TBS_ALERT color=”danger” heading=”Do not try to connect a file!”]If you try to connect files, you will notice that the “OK” button is grayed out, connecting folders allows you only to choose folders.[/TBS_ALERT]
View and Preview the data
After you’ve connected the folder, you can check Folder Connections and open the Folder which you’ve connected. Locate “workshop2018.gdb” and double click it to view its contents. Browse for us_states and click the “Preview” tab.
Hello Egypt: Setting the projection
Geographic coordinate systems are typically measured in decimal degrees, and are useful when your data is global and/or comes with latitude and longitude coordinates. However, because of its angular units, it is not recommended for spatial analysis. Instead, one should consider using a projected coordinate system that is suited to the region of analysis. Given that we are only working with Egypt based data, let’s set our projection to the following UTM zone that is specifically optimized for our region of interest:
Let’s set our projection with this in mind:
[TBS_ALERT color=”danger” heading=”It’s on the fly!”]The software will warn you that you are projecting your datasets on the fly (note that it is not reprojecting the actual data, it is doing so only within the scope of this project space). If you want to perform spatial analysis, it is recommended that all layers in your project be reprojected to an appropriate coordinate system. More information on how to do this can be found here.[/TBS_ALERT]
Adding Layers
Now the time has come to fire up ArcMap and become a digital cartographer! The first step for any GIS project is to have data (more on this later). In order to add data to your project click on the “Add data” button:
Notice how the connected folder can be selected and datasets be added now? Also, if your map is feeling a bit empty, you can add base maps by clicking the upside down triangle next to the Add Data button. Adding a basemap only provides reference information and nothing else.
Order your layers
Vector layers are also referred to as “feature classes” in ESRI-Land. All GIS datasets can be added in this same way. Now drag each layer and re-order them. If you are familiar with Adobe Photoshop or Illustrator, you will recognize conceptual similarities with layering. What happens when layers are re-ordered? How does this dictate your strategy on building a single flattened map with multiple layers?
[TBS_ALERT color=”info” heading=”Challenge Exercise”]Modify your map by changing fill colors, outline colors, symbol sizes, symbol colors to make it look like this:
[/TBS_ALERT]
Symbolization
Outlines, fills, colors, weight, action! Here is where the artist in you comes out and the design phase of creating a map begins. Consider color choices: grayscale? Color schemes? Color hierarchy? Inevitably, you will find yourselves in the throes of ESRI’s symbolization quagmire…
Labeling
Map elements need labels at times. Consider what needs to be labeled, and what does not. Label sizes, fonts, weights, placement, colors are all things to consider for your map. Understand the relationship between labels, attributes, and layers.
[TBS_ALERT color=”info” heading=”Labels hard to read? Halo it!”]Sometimes your labels may be hard to read, depending on what resides in the background. In this situation, you can add a white “halo” to your labels to make them “pop” some more. This feature is very, very hidden in ArcMap, but here is how to get to it:
[/TBS_ALERT]
Attributes
Every layer (feature class) comes with attributes. This is the all-important “information” part of geographic “information” systems mapping. Data in the attribute tables dictates what can get mapped. Open the attribute table of each layer (right click on the layer from the table of contents, Open Attribute Table):
Study how each row and column is tied to the mapped element. Questions we will answer include:
Choropleth Maps
For this section, we will focus on creating a choropleth (which just means a colored map based on numerical data)!
When creating a choropleth the following needs to be considered:
To create a choropleth map, follow these steps:
Now click on the Classify button. There are several methods to choose from. Look at the following documentation to determine which method is best suited for your data.
Part 2: Working with spatial data
Acquiring data
The open data movement has made more and more data available for academics to download and use for their research. But how can we map this data? This workshop will take you through the process of acquiring data from the Los Angeles Open Data portal and visualizing it on ArcGIS for further analysis.
Los Angeles Open Data portal
The Los Angeles Open Data Portal
Search for crime data
Inspect the data
Almost 2 million records! Let’s filter it down to something more manageable.
Now add the filter to narrow down the data to one month:
Export the data
Cleaning up those coordinates
Open the downloaded data in Excel. Scroll to the right until you see the Location column.
Hmm, that’s strange, the latitude and longitude columns are in the same column! ArcGIS does not like this. Let’s clean this up.
First, find and replace the brackets.
Repeat for the closing bracket.
Split the column into two:
Choose, delimited, check the “Comma” box, and finish.
Rename the column headers to Latitude and Longitude
Let’s map it!
Start a brand new ArcMap project and add the csv file (remember the Add Data button?). Right click on the csv file and Display XY Data.
Now save your new layer as a shapefile, or geodatabase:
Project the data
Our data is currently in a geographic coordinate system (WGS1984). Let’s change this to a projected coordinate system. The UTM zone for Los Angeles is UTM Zone 11N.
Click on the search tool
Type “project” and click on Project (Data Management)
Now, set the projection of the data frame. Right click on Layers, and go to properties. Then, set the coordinate system to NAD 1983 UTM Zone 11N
Hot spots?
Let’s find crime hot spots by race. Select incidents where the person arrested was classified as Hispanic (H). In the menu bar, go to Selection, Select by attribute. Enter the following SQL statement:
Victim_Decent = ‘H’
Now perform a kernel density to visualize the density of Hispanic arrests in Los Angeles. In the search box, enter “kernel” and click on the Kernel Density (Spatial Analyst) tool. Enter the four boxes as shown below:
Add a basemap, and change the symbology to make the visual more powerful:
Repeat the process for other race categories:
Data in this tutorial
Thanks for attending the workshop!
Please fill out the feedback form to see what we can improve upon:
Post workshop survey
For more learning you can check out ESRI’s tutorials:
http://www.esri.com/training/main/training-catalog/course-recommendations