import pandas as pd
import zipfile
import seaborn as sns
In this notebook we'll briefly review joining tables as discussed in data 8.
Often data is spread across two tables. Joining provides us with a way to naturally combine related tables.
Let's start by reading data from the given zip file. To showcase how to do read data that is inside zip files, we're going to use the zipfile
module. Doing so will allow us to avoid needing to unzip the data. Running the cell below, we see that the zip file contains elections.csv
and presidents.csv
.
join_demo_filename = "lec6_join_demo_data.zip"
my_zip = zipfile.ZipFile(join_demo_filename, 'r')
list_names = [f.filename for f in my_zip.filelist]
list_names
['elections.csv', 'presidents.csv']
We could call my_zip.extractall()
to unzip the files, but we won't. Instead, we'll read directly from the zip file itself.
with my_zip.open("elections.csv") as f:
elections = pd.read_csv(f)
elections.head(5)
Year | Candidate | Party | Popular vote | Result | % | |
---|---|---|---|---|---|---|
0 | 1824 | Andrew Jackson | Democratic-Republican | 151271 | loss | 57.210122 |
1 | 1824 | John Quincy Adams | Democratic-Republican | 113142 | win | 42.789878 |
2 | 1828 | Andrew Jackson | Democratic | 642806 | win | 56.203927 |
3 | 1828 | John Quincy Adams | National Republican | 500897 | loss | 43.796073 |
4 | 1832 | Andrew Jackson | Democratic | 702735 | win | 54.574789 |
with my_zip.open("presidents.csv") as f:
presidents = pd.read_csv(f)
presidents.head(5)
Date of birth | President | Birthplace | State of birth | In office | |
---|---|---|---|---|---|
0 | February 22, 1732 | George Washington | Westmoreland County | Virginia | (1st) April 30, 1789 – March 4, 1797 |
1 | October 30, 1735 | John Adams | Braintree | Massachusetts | (2nd) March 4, 1797 – March 4, 1801 |
2 | April 13, 1743 | Thomas Jefferson | Shadwell | Virginia | (3rd) March 4, 1801 – March 4, 1809 |
3 | March 16, 1751 | James Madison | Port Conway | Virginia | (4th) March 4, 1809 – March 4, 1817 |
4 | April 28, 1758 | James Monroe | Monroe Hall | Virginia | (5th) March 4, 1817 – March 4, 1825 |
To join tables df
and df2
, we call the function df.merge(df2)
. Merge is just the word that the authors of pandas picked for joining tables. I don't know why.
Note: Unfortunately, Pandas also has a function called df.join
. This is a limited version of merge
. For ths sake of generality, we will only use merge
in this class.
I can use the merge function to combine these two tables:
elections.merge(presidents,
how = "inner",
left_on = "Candidate", right_on = "President")
Year | Candidate | Party | Popular vote | Result | % | Date of birth | President | Birthplace | State of birth | In office | |
---|---|---|---|---|---|---|---|---|---|---|---|
0 | 1824 | Andrew Jackson | Democratic-Republican | 151271 | loss | 57.210122 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
1 | 1828 | Andrew Jackson | Democratic | 642806 | win | 56.203927 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
2 | 1832 | Andrew Jackson | Democratic | 702735 | win | 54.574789 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
3 | 1824 | John Quincy Adams | Democratic-Republican | 113142 | win | 42.789878 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
4 | 1828 | John Quincy Adams | National Republican | 500897 | loss | 43.796073 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
5 | 1836 | Martin Van Buren | Democratic | 763291 | win | 52.272472 | December 5, 1782 | Martin Van Buren | Kinderhook | New York | (8th) March 4, 1837 – March 4, 1841 |
6 | 1840 | Martin Van Buren | Democratic | 1128854 | loss | 46.948787 | December 5, 1782 | Martin Van Buren | Kinderhook | New York | (8th) March 4, 1837 – March 4, 1841 |
7 | 1848 | Martin Van Buren | Free Soil | 291501 | loss | 10.138474 | December 5, 1782 | Martin Van Buren | Kinderhook | New York | (8th) March 4, 1837 – March 4, 1841 |
8 | 1836 | William Henry Harrison | Whig | 550816 | loss | 37.721543 | February 9, 1773 | William Henry Harrison | Charles City County | Virginia | (9th) March 4, 1841 – April 4, 1841 |
9 | 1840 | William Henry Harrison | Whig | 1275583 | win | 53.051213 | February 9, 1773 | William Henry Harrison | Charles City County | Virginia | (9th) March 4, 1841 – April 4, 1841 |
10 | 1848 | Zachary Taylor | Whig | 1360235 | win | 47.309296 | November 24, 1784 | Zachary Taylor | Barboursville | Virginia | (12th) March 4, 1849 – July 9, 1850 |
11 | 1852 | Franklin Pierce | Democratic | 1605943 | win | 51.013168 | November 23, 1804 | Franklin Pierce | Hillsborough | New Hampshire | (14th) March 4, 1853 – March 4, 1857 |
12 | 1856 | James Buchanan | Democratic | 1835140 | win | 45.306080 | April 23, 1791 | James Buchanan | Cove Gap | Pennsylvania | (15th) March 4, 1857 – March 4, 1861 |
13 | 1856 | Millard Fillmore | American | 873053 | loss | 21.554001 | January 7, 1800 | Millard Fillmore | Summerhill | New York | (13th) July 9, 1850 – March 4, 1853 |
14 | 1860 | Abraham Lincoln | Republican | 1855993 | win | 39.699408 | February 12, 1809 | Abraham Lincoln | Sinking Spring | Kentucky | (16th) March 4, 1861 – April 15, 1865 |
15 | 1864 | Abraham Lincoln | National Union | 2211317 | win | 54.951512 | February 12, 1809 | Abraham Lincoln | Sinking Spring | Kentucky | (16th) March 4, 1861 – April 15, 1865 |
16 | 1884 | Grover Cleveland | Democratic | 4914482 | win | 48.884933 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (22nd) March 4, 1885 – March 4, 1889 |
17 | 1884 | Grover Cleveland | Democratic | 4914482 | win | 48.884933 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (24th) March 4, 1893 – March 4, 1897 |
18 | 1888 | Grover Cleveland | Democratic | 5534488 | loss | 48.656799 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (22nd) March 4, 1885 – March 4, 1889 |
19 | 1888 | Grover Cleveland | Democratic | 5534488 | loss | 48.656799 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (24th) March 4, 1893 – March 4, 1897 |
20 | 1892 | Grover Cleveland | Democratic | 5553898 | win | 46.121393 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (22nd) March 4, 1885 – March 4, 1889 |
21 | 1892 | Grover Cleveland | Democratic | 5553898 | win | 46.121393 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (24th) March 4, 1893 – March 4, 1897 |
22 | 1888 | Benjamin Harrison | Republican | 5443633 | win | 47.858041 | August 20, 1833 | Benjamin Harrison | North Bend | Ohio | (23rd) March 4, 1889 – March 4, 1893 |
23 | 1892 | Benjamin Harrison | Republican | 5176108 | loss | 42.984101 | August 20, 1833 | Benjamin Harrison | North Bend | Ohio | (23rd) March 4, 1889 – March 4, 1893 |
24 | 1896 | William McKinley | Republican | 7112138 | win | 51.213817 | January 29, 1843 | William McKinley | Niles | Ohio | (25th) March 4, 1897 – September 14, 1901 |
25 | 1900 | William McKinley | Republican | 7228864 | win | 52.342640 | January 29, 1843 | William McKinley | Niles | Ohio | (25th) March 4, 1897 – September 14, 1901 |
26 | 1904 | Theodore Roosevelt | Republican | 7630557 | win | 56.562787 | October 27, 1858 | Theodore Roosevelt | New York City | New York | (26th) September 14, 1901 – March 4, 1909 |
27 | 1912 | Theodore Roosevelt | Progressive | 4122721 | loss | 27.457433 | October 27, 1858 | Theodore Roosevelt | New York City | New York | (26th) September 14, 1901 – March 4, 1909 |
28 | 1912 | Woodrow Wilson | Democratic | 6296284 | win | 41.933422 | December 28, 1856 | Woodrow Wilson | Staunton | Virginia | (28th) March 4, 1913 – March 4, 1921 |
29 | 1916 | Woodrow Wilson | Democratic | 9126868 | win | 49.367987 | December 28, 1856 | Woodrow Wilson | Staunton | Virginia | (28th) March 4, 1913 – March 4, 1921 |
30 | 1924 | Calvin Coolidge | Republican | 15723789 | win | 54.329113 | July 4, 1872 | Calvin Coolidge | Plymouth | Vermont | (30th) August 2, 1923 – March 4, 1929 |
31 | 1928 | Herbert Hoover | Republican | 21427123 | win | 58.368524 | August 10, 1874 | Herbert Hoover | West Branch | Iowa | (31st) March 4, 1929 – March 4, 1933 |
32 | 1932 | Herbert Hoover | Republican | 15761254 | loss | 39.830594 | August 10, 1874 | Herbert Hoover | West Branch | Iowa | (31st) March 4, 1929 – March 4, 1933 |
33 | 1960 | Richard Nixon | Republican | 34108157 | loss | 49.917439 | January 9, 1913 | Richard Nixon | Yorba Linda | California | (37th) January 20, 1969 – August 9, 1974 |
34 | 1968 | Richard Nixon | Republican | 31783783 | win | 43.565246 | January 9, 1913 | Richard Nixon | Yorba Linda | California | (37th) January 20, 1969 – August 9, 1974 |
35 | 1972 | Richard Nixon | Republican | 47168710 | win | 60.907806 | January 9, 1913 | Richard Nixon | Yorba Linda | California | (37th) January 20, 1969 – August 9, 1974 |
36 | 1976 | Gerald Ford | Republican | 39148634 | loss | 48.199499 | July 14, 1913 | Gerald Ford | Omaha | Nebraska | (38th) August 9, 1974 – January 20, 1977 |
37 | 1976 | Jimmy Carter | Democratic | 40831881 | win | 50.271900 | October 1, 1924 | Jimmy Carter | Plains | Georgia | (39th) January 20, 1977 – January 20, 1981 |
38 | 1980 | Jimmy Carter | Democratic | 35480115 | loss | 41.132848 | October 1, 1924 | Jimmy Carter | Plains | Georgia | (39th) January 20, 1977 – January 20, 1981 |
39 | 1980 | Ronald Reagan | Republican | 43903230 | win | 50.897944 | February 6, 1911 | Ronald Reagan | Tampico | Illinois | (40th) January 20, 1981 – January 20, 1989 |
40 | 1984 | Ronald Reagan | Republican | 54455472 | win | 59.023326 | February 6, 1911 | Ronald Reagan | Tampico | Illinois | (40th) January 20, 1981 – January 20, 1989 |
41 | 1988 | George H. W. Bush | Republican | 48886597 | win | 53.518845 | June 12, 1924 | George H. W. Bush | Milton | Massachusetts | (41st) January 20, 1989 – January 20, 1993 |
42 | 1992 | George H. W. Bush | Republican | 39104550 | loss | 37.544784 | June 12, 1924 | George H. W. Bush | Milton | Massachusetts | (41st) January 20, 1989 – January 20, 1993 |
43 | 1992 | Bill Clinton | Democratic | 44909806 | win | 43.118485 | August 19, 1946 | Bill Clinton | Hope | Arkansas | (42nd) January 20, 1993 – January 20, 2001 |
44 | 1996 | Bill Clinton | Democratic | 47400125 | win | 49.296938 | August 19, 1946 | Bill Clinton | Hope | Arkansas | (42nd) January 20, 1993 – January 20, 2001 |
45 | 2000 | George W. Bush | Republican | 50456002 | win | 47.974666 | July 6, 1946 | George W. Bush | New Haven | Connecticut | (43rd) January 20, 2001 – January 20, 2009 |
46 | 2004 | George W. Bush | Republican | 62040610 | win | 50.771824 | July 6, 1946 | George W. Bush | New Haven | Connecticut | (43rd) January 20, 2001 – January 20, 2009 |
47 | 2016 | Donald Trump | Republican | 62984828 | win | 46.407862 | June 14, 1946 | Donald Trump | Queens | New York | (45th) January 20, 2017 – Incumbent |
Notice that:
Andrew Jackson
occurred three times in the election table and shows up three times in the output. Grover Cleveland
occurs six times! Twice for every election he was in. This is because he appears three times in the elections
table and twice in the presidents
table. This results in 3 x 2 = 6 combinations.With the caveats above in mind, tThis merged DataFrame is handy because we can use it to plot, e.g. the age of each president when they were elected.
joined = elections.merge(presidents,
how = "inner",
left_on = "Candidate", right_on = "President")
winners = joined.query("Result == 'win'").copy()
winners["Birthyear"] = winners["Date of birth"].str.split(',').str[1].map(int)
winners["Age"] = winners["Year"] - winners["Birthyear"]
sns.lmplot(data=winners, x="Year", y="Age")
<seaborn.axisgrid.FacetGrid at 0x7f4dc7382310>
We could group by name/candidate and take only the first:
(
elections.merge(presidents,
how = "inner",
left_on = "Candidate", right_on = "President")
.groupby(['Candidate', 'Year']).first().reset_index()
)
Candidate | Year | Party | Popular vote | Result | % | Date of birth | President | Birthplace | State of birth | In office | |
---|---|---|---|---|---|---|---|---|---|---|---|
0 | Abraham Lincoln | 1860 | Republican | 1855993 | win | 39.699408 | February 12, 1809 | Abraham Lincoln | Sinking Spring | Kentucky | (16th) March 4, 1861 – April 15, 1865 |
1 | Abraham Lincoln | 1864 | National Union | 2211317 | win | 54.951512 | February 12, 1809 | Abraham Lincoln | Sinking Spring | Kentucky | (16th) March 4, 1861 – April 15, 1865 |
2 | Andrew Jackson | 1824 | Democratic-Republican | 151271 | loss | 57.210122 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
3 | Andrew Jackson | 1828 | Democratic | 642806 | win | 56.203927 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
4 | Andrew Jackson | 1832 | Democratic | 702735 | win | 54.574789 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
5 | Benjamin Harrison | 1888 | Republican | 5443633 | win | 47.858041 | August 20, 1833 | Benjamin Harrison | North Bend | Ohio | (23rd) March 4, 1889 – March 4, 1893 |
6 | Benjamin Harrison | 1892 | Republican | 5176108 | loss | 42.984101 | August 20, 1833 | Benjamin Harrison | North Bend | Ohio | (23rd) March 4, 1889 – March 4, 1893 |
7 | Bill Clinton | 1992 | Democratic | 44909806 | win | 43.118485 | August 19, 1946 | Bill Clinton | Hope | Arkansas | (42nd) January 20, 1993 – January 20, 2001 |
8 | Bill Clinton | 1996 | Democratic | 47400125 | win | 49.296938 | August 19, 1946 | Bill Clinton | Hope | Arkansas | (42nd) January 20, 1993 – January 20, 2001 |
9 | Calvin Coolidge | 1924 | Republican | 15723789 | win | 54.329113 | July 4, 1872 | Calvin Coolidge | Plymouth | Vermont | (30th) August 2, 1923 – March 4, 1929 |
10 | Donald Trump | 2016 | Republican | 62984828 | win | 46.407862 | June 14, 1946 | Donald Trump | Queens | New York | (45th) January 20, 2017 – Incumbent |
11 | Franklin Pierce | 1852 | Democratic | 1605943 | win | 51.013168 | November 23, 1804 | Franklin Pierce | Hillsborough | New Hampshire | (14th) March 4, 1853 – March 4, 1857 |
12 | George H. W. Bush | 1988 | Republican | 48886597 | win | 53.518845 | June 12, 1924 | George H. W. Bush | Milton | Massachusetts | (41st) January 20, 1989 – January 20, 1993 |
13 | George H. W. Bush | 1992 | Republican | 39104550 | loss | 37.544784 | June 12, 1924 | George H. W. Bush | Milton | Massachusetts | (41st) January 20, 1989 – January 20, 1993 |
14 | George W. Bush | 2000 | Republican | 50456002 | win | 47.974666 | July 6, 1946 | George W. Bush | New Haven | Connecticut | (43rd) January 20, 2001 – January 20, 2009 |
15 | George W. Bush | 2004 | Republican | 62040610 | win | 50.771824 | July 6, 1946 | George W. Bush | New Haven | Connecticut | (43rd) January 20, 2001 – January 20, 2009 |
16 | Gerald Ford | 1976 | Republican | 39148634 | loss | 48.199499 | July 14, 1913 | Gerald Ford | Omaha | Nebraska | (38th) August 9, 1974 – January 20, 1977 |
17 | Grover Cleveland | 1884 | Democratic | 4914482 | win | 48.884933 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (22nd) March 4, 1885 – March 4, 1889 |
18 | Grover Cleveland | 1888 | Democratic | 5534488 | loss | 48.656799 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (22nd) March 4, 1885 – March 4, 1889 |
19 | Grover Cleveland | 1892 | Democratic | 5553898 | win | 46.121393 | March 18, 1837 | Grover Cleveland | Caldwell | New Jersey | (22nd) March 4, 1885 – March 4, 1889 |
20 | Herbert Hoover | 1928 | Republican | 21427123 | win | 58.368524 | August 10, 1874 | Herbert Hoover | West Branch | Iowa | (31st) March 4, 1929 – March 4, 1933 |
21 | Herbert Hoover | 1932 | Republican | 15761254 | loss | 39.830594 | August 10, 1874 | Herbert Hoover | West Branch | Iowa | (31st) March 4, 1929 – March 4, 1933 |
22 | James Buchanan | 1856 | Democratic | 1835140 | win | 45.306080 | April 23, 1791 | James Buchanan | Cove Gap | Pennsylvania | (15th) March 4, 1857 – March 4, 1861 |
23 | Jimmy Carter | 1976 | Democratic | 40831881 | win | 50.271900 | October 1, 1924 | Jimmy Carter | Plains | Georgia | (39th) January 20, 1977 – January 20, 1981 |
24 | Jimmy Carter | 1980 | Democratic | 35480115 | loss | 41.132848 | October 1, 1924 | Jimmy Carter | Plains | Georgia | (39th) January 20, 1977 – January 20, 1981 |
25 | John Quincy Adams | 1824 | Democratic-Republican | 113142 | win | 42.789878 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
26 | John Quincy Adams | 1828 | National Republican | 500897 | loss | 43.796073 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
27 | Martin Van Buren | 1836 | Democratic | 763291 | win | 52.272472 | December 5, 1782 | Martin Van Buren | Kinderhook | New York | (8th) March 4, 1837 – March 4, 1841 |
28 | Martin Van Buren | 1840 | Democratic | 1128854 | loss | 46.948787 | December 5, 1782 | Martin Van Buren | Kinderhook | New York | (8th) March 4, 1837 – March 4, 1841 |
29 | Martin Van Buren | 1848 | Free Soil | 291501 | loss | 10.138474 | December 5, 1782 | Martin Van Buren | Kinderhook | New York | (8th) March 4, 1837 – March 4, 1841 |
30 | Millard Fillmore | 1856 | American | 873053 | loss | 21.554001 | January 7, 1800 | Millard Fillmore | Summerhill | New York | (13th) July 9, 1850 – March 4, 1853 |
31 | Richard Nixon | 1960 | Republican | 34108157 | loss | 49.917439 | January 9, 1913 | Richard Nixon | Yorba Linda | California | (37th) January 20, 1969 – August 9, 1974 |
32 | Richard Nixon | 1968 | Republican | 31783783 | win | 43.565246 | January 9, 1913 | Richard Nixon | Yorba Linda | California | (37th) January 20, 1969 – August 9, 1974 |
33 | Richard Nixon | 1972 | Republican | 47168710 | win | 60.907806 | January 9, 1913 | Richard Nixon | Yorba Linda | California | (37th) January 20, 1969 – August 9, 1974 |
34 | Ronald Reagan | 1980 | Republican | 43903230 | win | 50.897944 | February 6, 1911 | Ronald Reagan | Tampico | Illinois | (40th) January 20, 1981 – January 20, 1989 |
35 | Ronald Reagan | 1984 | Republican | 54455472 | win | 59.023326 | February 6, 1911 | Ronald Reagan | Tampico | Illinois | (40th) January 20, 1981 – January 20, 1989 |
36 | Theodore Roosevelt | 1904 | Republican | 7630557 | win | 56.562787 | October 27, 1858 | Theodore Roosevelt | New York City | New York | (26th) September 14, 1901 – March 4, 1909 |
37 | Theodore Roosevelt | 1912 | Progressive | 4122721 | loss | 27.457433 | October 27, 1858 | Theodore Roosevelt | New York City | New York | (26th) September 14, 1901 – March 4, 1909 |
38 | William Henry Harrison | 1836 | Whig | 550816 | loss | 37.721543 | February 9, 1773 | William Henry Harrison | Charles City County | Virginia | (9th) March 4, 1841 – April 4, 1841 |
39 | William Henry Harrison | 1840 | Whig | 1275583 | win | 53.051213 | February 9, 1773 | William Henry Harrison | Charles City County | Virginia | (9th) March 4, 1841 – April 4, 1841 |
40 | William McKinley | 1896 | Republican | 7112138 | win | 51.213817 | January 29, 1843 | William McKinley | Niles | Ohio | (25th) March 4, 1897 – September 14, 1901 |
41 | William McKinley | 1900 | Republican | 7228864 | win | 52.342640 | January 29, 1843 | William McKinley | Niles | Ohio | (25th) March 4, 1897 – September 14, 1901 |
42 | Woodrow Wilson | 1912 | Democratic | 6296284 | win | 41.933422 | December 28, 1856 | Woodrow Wilson | Staunton | Virginia | (28th) March 4, 1913 – March 4, 1921 |
43 | Woodrow Wilson | 1916 | Democratic | 9126868 | win | 49.367987 | December 28, 1856 | Woodrow Wilson | Staunton | Virginia | (28th) March 4, 1913 – March 4, 1921 |
44 | Zachary Taylor | 1848 | Whig | 1360235 | win | 47.309296 | November 24, 1784 | Zachary Taylor | Barboursville | Virginia | (12th) March 4, 1849 – July 9, 1850 |
The above join was an inner join. What if we wanted to keep all of the presidents and leave missing data for years when there was no popular vote? In this case we'd do a "right" join, where we make sure to include EVERY row from our right dataframe, in this case presidents
.
elections.merge(presidents,
how = "right",
left_on = "Candidate", right_on = "President")
Year | Candidate | Party | Popular vote | Result | % | Date of birth | President | Birthplace | State of birth | In office | |
---|---|---|---|---|---|---|---|---|---|---|---|
0 | 1824.0 | Andrew Jackson | Democratic-Republican | 151271.0 | loss | 57.210122 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
1 | 1828.0 | Andrew Jackson | Democratic | 642806.0 | win | 56.203927 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
2 | 1832.0 | Andrew Jackson | Democratic | 702735.0 | win | 54.574789 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
3 | 1824.0 | John Quincy Adams | Democratic-Republican | 113142.0 | win | 42.789878 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
4 | 1828.0 | John Quincy Adams | National Republican | 500897.0 | loss | 43.796073 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
63 | NaN | NaN | NaN | NaN | NaN | NaN | May 8, 1884 | Harry S. Truman | Lamar | Missouri | (33rd) April 12, 1945 – January 20, 1953 |
64 | NaN | NaN | NaN | NaN | NaN | NaN | October 14, 1890 | Dwight D. Eisenhower | Denison | Texas | (34th) January 20, 1953 – January 20, 1961 |
65 | NaN | NaN | NaN | NaN | NaN | NaN | August 27, 1908 | Lyndon B. Johnson | Stonewall | Texas | (36th) November 22, 1963 – January 20, 1969 |
66 | NaN | NaN | NaN | NaN | NaN | NaN | May 29, 1917 | John F. Kennedy | Brookline | Massachusetts | (35th) January 20, 1961 – November 22, 1963 |
67 | NaN | NaN | NaN | NaN | NaN | NaN | August 4, 1961 | Barack H. Obama | Honolulu | Hawaii | (44th) January 20, 2009 – January 20, 2017 |
68 rows × 11 columns
Similarly, if we also want to include candidates not in the presidents table (e.g. because they had never won), we can use a "left" join.
elections.merge(presidents,
how = "left",
left_on = "Candidate", right_on = "President")
Year | Candidate | Party | Popular vote | Result | % | Date of birth | President | Birthplace | State of birth | In office | |
---|---|---|---|---|---|---|---|---|---|---|---|
0 | 1824 | Andrew Jackson | Democratic-Republican | 151271 | loss | 57.210122 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
1 | 1824 | John Quincy Adams | Democratic-Republican | 113142 | win | 42.789878 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
2 | 1828 | Andrew Jackson | Democratic | 642806 | win | 56.203927 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
3 | 1828 | John Quincy Adams | National Republican | 500897 | loss | 43.796073 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
4 | 1832 | Andrew Jackson | Democratic | 702735 | win | 54.574789 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
176 | 2016 | Donald Trump | Republican | 62984828 | win | 46.407862 | June 14, 1946 | Donald Trump | Queens | New York | (45th) January 20, 2017 – Incumbent |
177 | 2016 | Evan McMullin | Independent | 732273 | loss | 0.539546 | NaN | NaN | NaN | NaN | NaN |
178 | 2016 | Gary Johnson | Libertarian | 4489235 | loss | 3.307714 | NaN | NaN | NaN | NaN | NaN |
179 | 2016 | Hillary Clinton | Democratic | 65853514 | loss | 48.521539 | NaN | NaN | NaN | NaN | NaN |
180 | 2016 | Jill Stein | Green | 1457226 | loss | 1.073699 | NaN | NaN | NaN | NaN | NaN |
181 rows × 11 columns
If we wanted to keep both, we can instead do an "outer join".
elections.merge(presidents,
how = "outer",
left_on = "Candidate", right_on = "President")
Year | Candidate | Party | Popular vote | Result | % | Date of birth | President | Birthplace | State of birth | In office | |
---|---|---|---|---|---|---|---|---|---|---|---|
0 | 1824.0 | Andrew Jackson | Democratic-Republican | 151271.0 | loss | 57.210122 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
1 | 1828.0 | Andrew Jackson | Democratic | 642806.0 | win | 56.203927 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
2 | 1832.0 | Andrew Jackson | Democratic | 702735.0 | win | 54.574789 | March 15, 1767 | Andrew Jackson | Waxhaws Region | South/North Carolina | (7th) March 4, 1829 – March 4, 1837 |
3 | 1824.0 | John Quincy Adams | Democratic-Republican | 113142.0 | win | 42.789878 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
4 | 1828.0 | John Quincy Adams | National Republican | 500897.0 | loss | 43.796073 | July 11, 1767 | John Quincy Adams | Braintree | Massachusetts | (6th) March 4, 1825 – March 4, 1829 |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
196 | NaN | NaN | NaN | NaN | NaN | NaN | May 8, 1884 | Harry S. Truman | Lamar | Missouri | (33rd) April 12, 1945 – January 20, 1953 |
197 | NaN | NaN | NaN | NaN | NaN | NaN | October 14, 1890 | Dwight D. Eisenhower | Denison | Texas | (34th) January 20, 1953 – January 20, 1961 |
198 | NaN | NaN | NaN | NaN | NaN | NaN | August 27, 1908 | Lyndon B. Johnson | Stonewall | Texas | (36th) November 22, 1963 – January 20, 1969 |
199 | NaN | NaN | NaN | NaN | NaN | NaN | May 29, 1917 | John F. Kennedy | Brookline | Massachusetts | (35th) January 20, 1961 – November 22, 1963 |
200 | NaN | NaN | NaN | NaN | NaN | NaN | August 4, 1961 | Barack H. Obama | Honolulu | Hawaii | (44th) January 20, 2009 – January 20, 2017 |
201 rows × 11 columns