inctpc-list@list.cityoftacoma.org

Members of Intergovernmental Network Consortium of Tacoma-Pierce County

View all threads

Re: [inctpc-list] Route Changes cnty2701 cdr # 8072771; Infra 166784

MR
Matt Rhebeck
Thu, May 28, 2015 8:43 PM

Brandon,
I received no opposition to this change.  Please feel free to remove the ACL entries for 146.129.0.0 and 156.74.0.0 at 0700 tomorrow.  We will monitor to see what, if any, fallout there is from the change.

Thanks,

Matt Rhebeck
IT Systems Engineer Supervisor-Network
Pierce County IT
(253) 798-6758 - office
(253) 495-8187 - mobile
matt.rhebeck@co.pierce.wa.usmailto:mrhebec@co.pierce.wa.us

From: Seibel, Brandon (CTS) [mailto:brandon.seibel@cts.wa.gov]
Sent: Wednesday, May 27, 2015 3:12 PM
To: Chubu Yang (cbyang); Keith Artz
Cc: CTS DL NCC Operations; Matt Rhebeck
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

In talking with Pierce County,
Pierce County is looking to have CTS make the recommended changes to ACL 58, to remove the routes recommended by Chubu, to resolve the rest of the issues to South Sound 911.

We are currently waiting to hear back from Pierce County of when they would like CTS to make this change.

Thank you.

From: Chubu Yang (cbyang) [mailto:cbyang@cisco.com]
Sent: Wednesday, May 27, 2015 9:54 AM
To: Seibel, Brandon (CTS); Artz, Keith
Cc: CTS DL NCC Operations; mrhebec@co.pierce.wa.usmailto:mrhebec@co.pierce.wa.us
Subject: Re: Route Changes cnty2701 cdr # 8072771; Infra 166784

King County had worked on some routing change for the routes from King County (146.129.0.0) and City of Seattle (156.74.0.0). The summarized routes 146.129.0.0/16, 156.74.0.0/16 and some more specific routes were injected into IGN but the more specific routes could be withdrawn anytime in the future. IGN customer should follow the summarized routes for accessing King County and City of Seattle. The ACL entires for 146.129.0.0/16 and 156.74.0.0/16 should be removed as a permanent solution.

Thanks,
Chubu

From: <Seibel>, "Brandon (CTS)" <brandon.seibel@cts.wa.govmailto:brandon.seibel@cts.wa.gov>
Date: Wednesday, May 27, 2015 at 9:20 AM
To: "Artz, Keith" <Keith.Artz@SouthSound911.orgmailto:Keith.Artz@SouthSound911.org>
Cc: CTS DL NCC Operations <CTSDLNCCOperations@cts.wa.govmailto:CTSDLNCCOperations@cts.wa.gov>, Chubu Yang <cbyang@cisco.commailto:cbyang@cisco.com>, "mrhebec@co.pierce.wa.usmailto:mrhebec@co.pierce.wa.us" <mrhebec@co.pierce.wa.usmailto:mrhebec@co.pierce.wa.us>
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

This is due to the ACL still in Pierce County router.

Keith said that he will talk to Pierce County on ACL 58 to see if, Pierce County will have CTS make modification to this ACL, on CNTY2701 device to allow these routes through.

Waiting to hear back from Matt and Keith on this.

Thank you.

access-list 58 deny  12.0.0.0 0.255.255.255
access-list 58 deny  146.218.0.0 0.0.255.255
access-list 58 deny  63.0.0.0 0.255.255.255
access-list 58 deny  64.0.0.0 0.255.255.255
access-list 58 deny  65.0.0.0 0.255.255.255
access-list 58 deny  66.0.0.0 0.255.255.255
access-list 58 deny  67.0.0.0 0.255.255.255
access-list 58 deny  156.74.0.0 0.0.255.255
access-list 58 deny  156.128.0.0 0.0.255.255
access-list 58 deny  164.110.0.0 0.0.255.255
access-list 58 deny  166.213.0.0 0.0.255.255
access-list 58 deny  192.103.155.0 0.0.0.255
access-list 58 deny  192.103.235.0 0.0.0.255
access-list 58 deny  192.103.236.0 0.0.0.255
access-list 58 deny  198.238.33.0 0.0.0.255
access-list 58 deny  146.129.0.0 0.0.0.255
access-list 58 deny  146.129.249.0 0.0.0.255
access-list 58 deny  146.129.250.0 0.0.0.255
access-list 58 deny  131.191.0.0 0.0.127.255
access-list 58 deny  207.202.185.0 0.0.0.255
access-list 58 permit any

From: Artz, Keith [mailto:Keith.Artz@SouthSound911.org]
Sent: Tuesday, May 26, 2015 11:49 AM
To: Calhoun, Joshua (CTS); Mills, Mark (CTS); Seibel, Brandon (CTS); 'McPherson, Ed'; Parker, Jeremiah (CTS)
Cc: CTS DL NCC Operations; 'Aryal, Anjana'; 'Chubu Yang (cbyang)'
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

Email communication to City of federal way is also not working.  The path to 146.129.247.210.0 traverses the Internet instead of the regional ring as well.

Keith Artz
Network Engineer
253-798-7249
Keith.Artz@SouthSound911.orgmailto:artzk@lesa.net

[cid:image001.jpg@01D0994C.49693420]

From: Artz, Keith
Sent: Tuesday, May 26, 2015 8:32 AM
To: 'Calhoun, Joshua (CTS)'; Mills, Mark (CTS); Seibel, Brandon (CTS); McPherson, Ed; Parker, Jeremiah (CTS)
Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang)
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

It looks like Auburn is working but I'm still not picking up routes for Seattle PD or Kent.

Seattle PD
156.74.65.0/?
156.74.191.0/?
156.74.193.0/?

Kent
146.129.252.0/?

I have not

Keith Artz
Network Engineer
253-798-7249
Keith.Artz@SouthSound911.orgmailto:artzk@lesa.net

[cid:image001.jpg@01D0994C.49693420]

From: Calhoun, Joshua (CTS) [mailto:joshua.calhoun@cts.wa.gov]
Sent: Tuesday, May 26, 2015 7:29 AM
To: Mills, Mark (CTS); Seibel, Brandon (CTS); McPherson, Ed; Parker, Jeremiah (CTS); Artz, Keith
Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang)
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

Hi Keith,

How are things running? Checking in from the NCC

Thanks,

Josh

From: Mills, Mark (CTS)
Sent: Friday, May 22, 2015 7:03 PM
To: Seibel, Brandon (CTS); McPherson, Ed; Parker, Jeremiah (CTS); Artz, Keith
Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang)
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

Keith,

Is everything operational for you now?

Mark Mills
Wa State Consolidated Technology Services
Network Control Center

From: Seibel, Brandon (CTS)
Sent: Friday, May 22, 2015 7:03 AM
To: McPherson, Ed; Parker, Jeremiah (CTS); Artz, Keith
Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang)
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

Thank you.
I am now seeing the route in the Pierce County router.

Just need Keith to check and verify that they can reach the  146.129.246.66 address now.

Thank you.

            |||||||||||||||||||||||||||||||
            ||                           ||
            ||    CNTY2701 Pierce County ||
            ||    3629 South D St        ||
            ||    Lower Lvl Terminal Rm  ||
            ||    Tacoma, WA             ||
            ||    SN: FOC16100Z5N        ||
            ||    State:                 ||
            ||                           ||
            |||||||||||||||||||||||||||||||

CNTY2701>en
Password:
CNTY2701#sh ip route | i 146.129.246
D EX    146.129.246.160/27
D EX    146.129.246.64/27
CNTY2701#

From: McPherson, Ed [mailto:Ed.McPherson@kingcounty.gov]
Sent: Thursday, May 21, 2015 4:45 PM
To: Seibel, Brandon (CTS); Parker, Jeremiah (CTS); Artz, Keith
Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang)
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

Brandon,

We were able to get approval from our network manager to put in the fix for the specific subnet to be advertised out to State IGN so that Pierce County can pick up the route advertisement for that specific subnet.

Chubu Yang of Cisco NOS will also be on the call so that he can double check on your side if you indeed are getting the route advertisement.

Emergency change will be done this 5:00 pm.

Thanks,
Ed

From: Seibel, Brandon (CTS) [mailto:brandon.seibel@cts.wa.gov]
Sent: Thursday, May 21, 2015 10:42 AM
To: Parker, Jeremiah (CTS); Artz, Keith
Cc: CTS DL NCC Operations; McPherson, Ed
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

Called King County for an update on this issue.  The Tech is currently in a meeting but they are expected to put the fix in place this afternoon for this issue.

Waiting for a call back from King County

Thank you.

From: Seibel, Brandon (CTS)
Sent: Thursday, May 21, 2015 9:31 AM
To: Parker, Jeremiah (CTS); Artz, Keith
Cc: CTS DL NCC Operations
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

Called King County and open a ticket up with them on this route advertisement.

Waiting for call back from King County.

The Class B route advertisement is hitting Pierce County ACL therefor causing it to be deny for the route back.  Before there were more detail routes that allowed access through, that has been removed off of the King County side.  King County just needs to re-add the more detail routes for 146.129.246.? /?  IP to allow this to work.

Thank you.

From: Parker, Jeremiah (CTS)
Sent: Wednesday, May 20, 2015 9:48 PM
To: Artz, Keith
Cc: CTS DL NCC Operations
Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784

Hello Keith,

I follow the routes for a network you sent us in the original request (146.129.246.66). I found this network going out to the CNTY1702 router which is in King County.

CNTY1702#sh ip route 146.129.246.66
Routing entry for 146.129.0.0 255.255.0.0
Known via "eigrp 1", distance 170, metric 28416
Tag 2544, type external
Redistributing via eigrp 1
Last update from 198.49.222.36 on GigabitEthernet0/0, 2w3d ago
Routing Descriptor Blocks:

  • 198.49.222.36, from 198.49.222.36, 2w3d ago, via GigabitEthernet0/0
    Route metric is 28416, traffic share count is 1
    Total delay is 110 microseconds, minimum bandwidth is 100000 Kbit
    Reliability 255/255, minimum MTU 1500 bytes
    Loading 255/255, Hops 1
    Route tag 2544

interface GigabitEthernet0/0
description to King Co.
ip address 198.49.222.33 255.255.255.240
ip access-group 151 in
no ip unreachables
no ip proxy-arp
ip route-cache flow
duplex full
speed 100
no cdp enable

The routing is working fine for the segments we have access to. I was told that King County had changed some of their advertisements during a fail back testing around the same time you lost access to the IGN connection. It looks like King County removed some static routes (one of which is ip route 146.129.0.0 255.255.0.0 198.49.222.36) to add dynamic routing. Are there any other networks you are having issues with? It looks like this will need to be followed up with King County to find out how they changed advertising their routes and what they changed the routes to.

Jeremiah Parker
Network Control Center, Swing Shift
Consolidated Technology Services

Brandon, I received no opposition to this change. Please feel free to remove the ACL entries for 146.129.0.0 and 156.74.0.0 at 0700 tomorrow. We will monitor to see what, if any, fallout there is from the change. Thanks, Matt Rhebeck IT Systems Engineer Supervisor-Network Pierce County IT (253) 798-6758 - office (253) 495-8187 - mobile matt.rhebeck@co.pierce.wa.us<mailto:mrhebec@co.pierce.wa.us> From: Seibel, Brandon (CTS) [mailto:brandon.seibel@cts.wa.gov] Sent: Wednesday, May 27, 2015 3:12 PM To: Chubu Yang (cbyang); Keith Artz Cc: CTS DL NCC Operations; Matt Rhebeck Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 In talking with Pierce County, Pierce County is looking to have CTS make the recommended changes to ACL 58, to remove the routes recommended by Chubu, to resolve the rest of the issues to South Sound 911. We are currently waiting to hear back from Pierce County of when they would like CTS to make this change. Thank you. From: Chubu Yang (cbyang) [mailto:cbyang@cisco.com] Sent: Wednesday, May 27, 2015 9:54 AM To: Seibel, Brandon (CTS); Artz, Keith Cc: CTS DL NCC Operations; mrhebec@co.pierce.wa.us<mailto:mrhebec@co.pierce.wa.us> Subject: Re: Route Changes cnty2701 cdr # 8072771; Infra 166784 King County had worked on some routing change for the routes from King County (146.129.0.0) and City of Seattle (156.74.0.0). The summarized routes 146.129.0.0/16, 156.74.0.0/16 and some more specific routes were injected into IGN but the more specific routes could be withdrawn anytime in the future. IGN customer should follow the summarized routes for accessing King County and City of Seattle. The ACL entires for 146.129.0.0/16 and 156.74.0.0/16 should be removed as a permanent solution. Thanks, Chubu From: <Seibel>, "Brandon (CTS)" <brandon.seibel@cts.wa.gov<mailto:brandon.seibel@cts.wa.gov>> Date: Wednesday, May 27, 2015 at 9:20 AM To: "Artz, Keith" <Keith.Artz@SouthSound911.org<mailto:Keith.Artz@SouthSound911.org>> Cc: CTS DL NCC Operations <CTSDLNCCOperations@cts.wa.gov<mailto:CTSDLNCCOperations@cts.wa.gov>>, Chubu Yang <cbyang@cisco.com<mailto:cbyang@cisco.com>>, "mrhebec@co.pierce.wa.us<mailto:mrhebec@co.pierce.wa.us>" <mrhebec@co.pierce.wa.us<mailto:mrhebec@co.pierce.wa.us>> Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 This is due to the ACL still in Pierce County router. Keith said that he will talk to Pierce County on ACL 58 to see if, Pierce County will have CTS make modification to this ACL, on CNTY2701 device to allow these routes through. Waiting to hear back from Matt and Keith on this. Thank you. access-list 58 deny 12.0.0.0 0.255.255.255 access-list 58 deny 146.218.0.0 0.0.255.255 access-list 58 deny 63.0.0.0 0.255.255.255 access-list 58 deny 64.0.0.0 0.255.255.255 access-list 58 deny 65.0.0.0 0.255.255.255 access-list 58 deny 66.0.0.0 0.255.255.255 access-list 58 deny 67.0.0.0 0.255.255.255 access-list 58 deny 156.74.0.0 0.0.255.255 access-list 58 deny 156.128.0.0 0.0.255.255 access-list 58 deny 164.110.0.0 0.0.255.255 access-list 58 deny 166.213.0.0 0.0.255.255 access-list 58 deny 192.103.155.0 0.0.0.255 access-list 58 deny 192.103.235.0 0.0.0.255 access-list 58 deny 192.103.236.0 0.0.0.255 access-list 58 deny 198.238.33.0 0.0.0.255 access-list 58 deny 146.129.0.0 0.0.0.255 access-list 58 deny 146.129.249.0 0.0.0.255 access-list 58 deny 146.129.250.0 0.0.0.255 access-list 58 deny 131.191.0.0 0.0.127.255 access-list 58 deny 207.202.185.0 0.0.0.255 access-list 58 permit any From: Artz, Keith [mailto:Keith.Artz@SouthSound911.org] Sent: Tuesday, May 26, 2015 11:49 AM To: Calhoun, Joshua (CTS); Mills, Mark (CTS); Seibel, Brandon (CTS); 'McPherson, Ed'; Parker, Jeremiah (CTS) Cc: CTS DL NCC Operations; 'Aryal, Anjana'; 'Chubu Yang (cbyang)' Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 Email communication to City of federal way is also not working. The path to 146.129.247.210.0 traverses the Internet instead of the regional ring as well. Keith Artz Network Engineer 253-798-7249 Keith.Artz@SouthSound911.org<mailto:artzk@lesa.net> [cid:image001.jpg@01D0994C.49693420] From: Artz, Keith Sent: Tuesday, May 26, 2015 8:32 AM To: 'Calhoun, Joshua (CTS)'; Mills, Mark (CTS); Seibel, Brandon (CTS); McPherson, Ed; Parker, Jeremiah (CTS) Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang) Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 It looks like Auburn is working but I'm still not picking up routes for Seattle PD or Kent. Seattle PD 156.74.65.0/? 156.74.191.0/? 156.74.193.0/? Kent 146.129.252.0/? I have not Keith Artz Network Engineer 253-798-7249 Keith.Artz@SouthSound911.org<mailto:artzk@lesa.net> [cid:image001.jpg@01D0994C.49693420] From: Calhoun, Joshua (CTS) [mailto:joshua.calhoun@cts.wa.gov] Sent: Tuesday, May 26, 2015 7:29 AM To: Mills, Mark (CTS); Seibel, Brandon (CTS); McPherson, Ed; Parker, Jeremiah (CTS); Artz, Keith Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang) Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 Hi Keith, How are things running? Checking in from the NCC Thanks, Josh From: Mills, Mark (CTS) Sent: Friday, May 22, 2015 7:03 PM To: Seibel, Brandon (CTS); McPherson, Ed; Parker, Jeremiah (CTS); Artz, Keith Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang) Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 Keith, Is everything operational for you now? Mark Mills Wa State Consolidated Technology Services Network Control Center From: Seibel, Brandon (CTS) Sent: Friday, May 22, 2015 7:03 AM To: McPherson, Ed; Parker, Jeremiah (CTS); Artz, Keith Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang) Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 Thank you. I am now seeing the route in the Pierce County router. Just need Keith to check and verify that they can reach the 146.129.246.66 address now. Thank you. ||||||||||||||||||||||||||||||| || || || CNTY2701 Pierce County || || 3629 South D St || || Lower Lvl Terminal Rm || || Tacoma, WA || || SN: FOC16100Z5N || || State: || || || ||||||||||||||||||||||||||||||| CNTY2701>en Password: CNTY2701#sh ip route | i 146.129.246 D EX 146.129.246.160/27 D EX 146.129.246.64/27 CNTY2701# From: McPherson, Ed [mailto:Ed.McPherson@kingcounty.gov] Sent: Thursday, May 21, 2015 4:45 PM To: Seibel, Brandon (CTS); Parker, Jeremiah (CTS); Artz, Keith Cc: CTS DL NCC Operations; Aryal, Anjana; Chubu Yang (cbyang) Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 Brandon, We were able to get approval from our network manager to put in the fix for the specific subnet to be advertised out to State IGN so that Pierce County can pick up the route advertisement for that specific subnet. Chubu Yang of Cisco NOS will also be on the call so that he can double check on your side if you indeed are getting the route advertisement. Emergency change will be done this 5:00 pm. Thanks, Ed From: Seibel, Brandon (CTS) [mailto:brandon.seibel@cts.wa.gov] Sent: Thursday, May 21, 2015 10:42 AM To: Parker, Jeremiah (CTS); Artz, Keith Cc: CTS DL NCC Operations; McPherson, Ed Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 Called King County for an update on this issue. The Tech is currently in a meeting but they are expected to put the fix in place this afternoon for this issue. Waiting for a call back from King County Thank you. From: Seibel, Brandon (CTS) Sent: Thursday, May 21, 2015 9:31 AM To: Parker, Jeremiah (CTS); Artz, Keith Cc: CTS DL NCC Operations Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 Called King County and open a ticket up with them on this route advertisement. Waiting for call back from King County. The Class B route advertisement is hitting Pierce County ACL therefor causing it to be deny for the route back. Before there were more detail routes that allowed access through, that has been removed off of the King County side. King County just needs to re-add the more detail routes for 146.129.246.? /? IP to allow this to work. Thank you. From: Parker, Jeremiah (CTS) Sent: Wednesday, May 20, 2015 9:48 PM To: Artz, Keith Cc: CTS DL NCC Operations Subject: RE: Route Changes cnty2701 cdr # 8072771; Infra 166784 Hello Keith, I follow the routes for a network you sent us in the original request (146.129.246.66). I found this network going out to the CNTY1702 router which is in King County. CNTY1702#sh ip route 146.129.246.66 Routing entry for 146.129.0.0 255.255.0.0 Known via "eigrp 1", distance 170, metric 28416 Tag 2544, type external Redistributing via eigrp 1 Last update from 198.49.222.36 on GigabitEthernet0/0, 2w3d ago Routing Descriptor Blocks: * 198.49.222.36, from 198.49.222.36, 2w3d ago, via GigabitEthernet0/0 Route metric is 28416, traffic share count is 1 Total delay is 110 microseconds, minimum bandwidth is 100000 Kbit Reliability 255/255, minimum MTU 1500 bytes Loading 255/255, Hops 1 Route tag 2544 interface GigabitEthernet0/0 description to King Co. ip address 198.49.222.33 255.255.255.240 ip access-group 151 in no ip unreachables no ip proxy-arp ip route-cache flow duplex full speed 100 no cdp enable The routing is working fine for the segments we have access to. I was told that King County had changed some of their advertisements during a fail back testing around the same time you lost access to the IGN connection. It looks like King County removed some static routes (one of which is ip route 146.129.0.0 255.255.0.0 198.49.222.36) to add dynamic routing. Are there any other networks you are having issues with? It looks like this will need to be followed up with King County to find out how they changed advertising their routes and what they changed the routes to. Jeremiah Parker Network Control Center, Swing Shift Consolidated Technology Services