Details of upload e80eff17-5473-4d0b-ad2f-f92d3514625b

Created at
2022-09-15T14:11:31.836Z
Total number of tests
804
JUnit report XML
View report
GitHub repository
ably/ably-cocoa
Commit SHA
432bd6e
Pull request base ref
main
Pull request head ref
integration/no_connection_time_serial
Branch / tag name
1496/merge
Workflow asset retention period
90 days
GitHub action
__run_5
GitHub run ID
3061029560
GitHub run attempt
1
GitHub run number
264
GitHub job
check
GitHub job URL
Not known
Loop iteration
1

Test failures

There are 26 failures in this upload.

Failure ID Test case ID Test class Test case Message
bdd32401-8ab6-4a0b-8695-e3941c18f9da 3d3a2781-f9cc-42a5-9576-37b79fc2cc4f RealtimeClientConnectionTests test__082__Connection__Connection_recovery__when_a_connection_is_successfully_recovered__Connection_id_will_be_identical_to_the_id_of_the_connection_that_was_recovered_and_Connection_key_will_always_be_updated_to_the_ConnectionDetails_connectionKey_provided_in_the_first_CONNECTED_ProtocolMessage() expected to equal <-Wpdp7MR0W>, got <_oSCS_safl> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3101&StartingLineNumber=3101)
f848c7a6-0eef-46a4-8137-4856915f9c77 181c0d92-7356-4faf-acd0-7cc9b78a0aa2 AuthTests test__148__JWT_and_realtime__when_token_expires_and_has_a_means_to_renew__reconnects_using_authCallback_and_obtains_a_new_token() expected to equal <G_1HMMGERJ>, got <9IdOwhTjFg> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/AuthTests.swift#CharacterRangeLen=0&EndingLineNumber=4180&StartingLineNumber=4180)
7d96f001-c09f-43d3-bb7e-b9e41638968a 1cf86794-ca47-4832-a5b5-2c9cc8f9586f RealtimeClientChannelTests test__011__Channel__EventEmitter__channel_states_and_events__ChannelStateChange_will_contain_a_resumed_boolean_attribute_with_value__true__if_the_bit_flag_RESUMED_was_included() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=506&StartingLineNumber=506)
baced195-de85-4e31-8923-d1d815742e7e 896d48fd-c709-4e4a-9b12-bcd9504dd99f RealtimeClientConnectionTests test__003__Connection__API_version_param_must_be_included_in_all_connections() expected to param <v=1.2> exists, got <key=_tmp_CaJ6Ew.EY_gUA:hfYXBsh7abRuS4yIhg5GhKhmssdNx4LSLUd21rH9Zgc&echo=true&agent=ably-cocoa/1.2.13%20macOS/10.15.7&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=351&StartingLineNumber=351)
03be1315-bf58-4263-84ee-b3a1dd08372e 89889c54-8d41-4c49-a967-c0c1f051c5e6 RealtimeClientConnectionTests test__033__Connection__ACK_and_NACK__ProtocolMessage__should_continue_incrementing_msgSerial_serially_if_the_connection_resumes_successfully() expected to equal <5>, got <0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1068&StartingLineNumber=1068)
4947764d-1e00-48d8-afba-be7e7cb6796f 4e71277a-67db-4317-9b0a-ac4ad4c6451e RealtimeClientConnectionTests test__034__Connection__ACK_and_NACK__ProtocolMessage__should_reset_msgSerial_serially_if_the_connection_does_not_resume() expected to equal <40012>, got <90001> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1139&StartingLineNumber=1139)
d99804e7-77d7-48f0-8dc6-df3620d86914 c04a5534-6e53-49f5-b598-550bb4089dc6 RealtimeClientConnectionTests test__054__Connection__connection_request_fails__on_DISCONNECTED_after_CONNECTED__should_not_emit_error_with_a_renewable_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1923&StartingLineNumber=1923)
0493a94c-f070-48d8-a78f-7a4604aee7bc d461b7e0-3cb1-49ba-b6f4-7a85cd2f7681 RealtimeClientConnectionTests test__061__Connection__connection_request_fails__should_change_the_state_to_SUSPENDED_when_the_connection_state_has_been_in_the_DISCONNECTED_state_for_more_than_the_connectionStateTtl() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2265&StartingLineNumber=2265)
7ee229c7-8ada-4b77-a4be-7df86a8816d1 8a0dcaeb-fe47-495d-8269-63b823db2177 RealtimeClientConnectionTests test__066__Connection__connection_failures_once_CONNECTED__ACK_and_NACK_responses_for_published_messages_can_only_ever_be_received_on_the_transport_connection_on_which_those_messages_were_sent() Shouldn't be called (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2787&StartingLineNumber=2787)
edefbf71-4f5c-4b4b-9518-ecdb20482e64 8bee007f-fc22-44f9-9ef4-2e1f4e2b476a RealtimeClientConnectionTests test__068__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client__and_no_error() expected to equal <8yryd3LUqK>, got <gA3ikhY6iE> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2447&StartingLineNumber=2447)
3630bc23-2d1c-4497-b9dc-b1c37714f351 b2ea3eff-5e84-425d-947f-de001e3f7c3f RealtimeClientConnectionTests test__069__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client_and_an_non_fatal_error() expected to equal <rE2_AsWBnT>, got <smEAfBJBcM> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2495&StartingLineNumber=2495)
e65c7c71-0965-4dfd-b27d-7ebb17f3e615 e563b0c8-d19a-4f85-95d6-e104e15bf2d7 RealtimeClientConnectionTests test__070__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_a_new_connectionId_and_an_error() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2528&StartingLineNumber=2528)
9f6e4d3d-2d1b-455f-a149-1073f2c56a57 5b38c413-5707-4522-af8e-b9f76f441add RealtimeClientConnectionTests test__075__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_passed_since_last_activity__reattaches_to_the_same_channels_after_a_new_connection_has_been_established() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2853&StartingLineNumber=2853)
132ee968-95c6-4e87-9b1a-523f6242fb6b 902857b0-ca0b-4d90-8165-f4ee2474cf7f RealtimeClientConnectionTests test__076__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_NOT_passed_since_last_activity__uses_the_same_connection() expected to equal <svHXWDGV9Z>, got <IkP9fSP7DL> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2899&StartingLineNumber=2899)
d1ee4c6b-1f18-4020-bc91-1495dbf87737 4fd7290a-0a6a-415b-aad2-715d7c897f84 RealtimeClientConnectionTests test__100__Connection__Host_Fallback__should_move_to_disconnected_when_there_s_no_internet__with_NSPOSIXErrorDomain_with_code_57() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=76&StartingLineNumber=76)
98a49c12-e96d-4238-8f73-5e9ef7a933bd e5b94fba-1e6f-411a-9356-68480d872058 RealtimeClientConnectionTests test__108__Connection__Operating_System_events_for_network_internet_connectivity_changes__re_authenticate_and_resume_the_connection_when_the_client_is_forcibly_disconnected_following_a_DISCONNECTED_message_containing_an_error_code_greater_than_or_equal_to_40140_and_less_than_40150() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=4256&StartingLineNumber=4256)
d263a14e-40e6-4b12-b303-3bad560ac728 f03a47fa-2ca3-4d5d-a1f0-b922bba53d81 RealtimeClientPresenceTests test__023__Presence__Channel_state_change_side_effects__channel_enters_the_SUSPENDED_state__should_maintain_the_PresenceMap_and_any_members_present_before_and_after_the_sync_should_not_emit_presence_events() expected to have Array<ARTPresenceMessage> with count 3, got 4 Actual Value: [<ARTPresenceMessage: 0x7f8d169f3bc0> {id: v1dESncQpU:1:0,clientId: user2,connectionId: v1dESncQpU,timestamp: 2022-09-15 14:06:29 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f8d169f3c10> {id: v1dESncQpU:2:0,clientId: user3,connectionId: v1dESncQpU,timestamp: 2022-09-15 14:06:29 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f8d169f4200> {id: v1dESncQpU:0:0,clientId: user1,connectionId: v1dESncQpU,timestamp: 2022-09-15 14:06:29 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f8d145b6f00> {id: -qHSFm6-tU:0:0,clientId: tester,connectionId: -qHSFm6-tU,timestamp: 2022-09-15 14:06:29 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}] (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=787&StartingLineNumber=787)
5e1499ab-4f45-4f72-b525-d351c1738fc4 1a0d6474-285c-4fcb-8aba-438c3723ad7b RealtimeClientPresenceTests test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED() expected to be nil, got <Error 90001 - Unable to perform operation on channel: test-314--OSX-test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED-684943651.427114-D17E11F3-6C70-44BB-B7DD-4A77759DC4CA (not currently attached)> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=3039&StartingLineNumber=3039)
6001f7d4-def2-4a9c-9208-7f686a83e0f4 4ba6726c-a48c-46fa-85c2-31ee6db80716 RealtimeClientTests test__001__RealtimeClient__All_WebSocket_connections_should_include_the_current_API_version() expected to param <v=1.2> exists, got <key=_tmp_CaJ6Ew.EY_gUA:hfYXBsh7abRuS4yIhg5GhKhmssdNx4LSLUd21rH9Zgc&echo=true&agent=ably-cocoa/1.2.13%20macOS/10.15.7&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=51&StartingLineNumber=51)
972b5f81-d10b-4d19-bc68-3450b11094f6 da4d7d42-c79b-45fe-8d99-4ea6377fbabf RealtimeClientTests test__006__RealtimeClient__should_accept_acks_with_different_order() failed - 80018: Invalid connection serial (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
d53338a8-2ffd-4535-ad0c-0547c58932a0 be9e53f7-9876-4494-b1df-4f4071258a94 RealtimeClientTests test__016__RealtimeClient__options__should_attempt_to_recover_the_connection_state_if_recover_string_is_assigned() failed - 40007: Unable to recover connection (requested connectionSerial is after the most recent one we could locate) (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
1211424c-3afe-40a4-ac4d-c3886cdcce09 e3b1b00c-fa5a-4e37-9ad9-e6ca8adad4e2 RealtimeClientTests test__037__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_SUSPENDED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1053&StartingLineNumber=1053)
6f5719a2-dc4f-4882-aaba-e9ac9135cb6e c2b81ea2-d06c-41a7-b217-36a144da77e5 RealtimeClientTests test__039__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_DISCONNECTED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1163&StartingLineNumber=1163)
46074617-7b11-4312-95da-69c366371612 a54428fb-682f-4f07-98b2-9c7ed614f0c3 RealtimeClientTests test__040__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_FAILED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1218&StartingLineNumber=1218)
a79e9360-a9f9-4f07-85e9-3e430ce25142 3454ff51-e12f-4e5b-a328-1344bf55934b RestClientTests test__001__RestClient__All_REST_requests_should_include_the_current_API_version() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=156&StartingLineNumber=156)
a2792109-f9b3-44be-8294-92751c30b34c 36841c8e-f199-458e-8fcc-867af1261a18 RestClientTests test__010__RestClient__X_Ably_Version_must_be_included_in_all_REST_requests() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1648&StartingLineNumber=1648)