Details of upload 8d908e20-6c5d-4637-902e-5308fb5e7c32

Created at
2022-09-15T17:08:54.144Z
Total number of tests
804
JUnit report XML
View report
GitHub repository
ably/ably-cocoa
Commit SHA
f9bebfc
Pull request base ref
main
Pull request head ref
integration/no_connection_time_serial
Branch / tag name
1496/merge
Workflow asset retention period
90 days
GitHub action
__run_5
GitHub run ID
3062163964
GitHub run attempt
1
GitHub run number
266
GitHub job
check
GitHub job URL
Not known
Loop iteration
1

Test failures

There are 25 failures in this upload.

Failure ID Test case ID Test class Test case Message
082beb69-67dc-4a5d-8577-007a8111146c 181c0d92-7356-4faf-acd0-7cc9b78a0aa2 AuthTests test__148__JWT_and_realtime__when_token_expires_and_has_a_means_to_renew__reconnects_using_authCallback_and_obtains_a_new_token() expected to equal <QBlU9TZ5lb>, got <gvcu8120Q5> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/AuthTests.swift#CharacterRangeLen=0&EndingLineNumber=4180&StartingLineNumber=4180)
2026e6bf-3c80-4d47-a0c8-10d4d7397e68 1cf86794-ca47-4832-a5b5-2c9cc8f9586f RealtimeClientChannelTests test__011__Channel__EventEmitter__channel_states_and_events__ChannelStateChange_will_contain_a_resumed_boolean_attribute_with_value__true__if_the_bit_flag_RESUMED_was_included() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=506&StartingLineNumber=506)
e4283935-f83c-4511-ae1b-c55189c9393c 896d48fd-c709-4e4a-9b12-bcd9504dd99f RealtimeClientConnectionTests test__003__Connection__API_version_param_must_be_included_in_all_connections() expected to param <v=1.2> exists, got <key=_tmp_uezK1A.7M5Vgg:WA1tOKi1fMZSGdY_0UxmlXgrAT9x7cAM2jYttVedDo0&echo=true&agent=ably-cocoa/1.2.13%20macOS/10.15.7&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=351&StartingLineNumber=351)
a5c6dbb3-c142-4f0e-a113-552bee02ba3b 89889c54-8d41-4c49-a967-c0c1f051c5e6 RealtimeClientConnectionTests test__033__Connection__ACK_and_NACK__ProtocolMessage__should_continue_incrementing_msgSerial_serially_if_the_connection_resumes_successfully() expected to equal <5>, got <0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1068&StartingLineNumber=1068)
a9bc99a5-2af2-4f44-bff3-f31e92a7afb8 4e71277a-67db-4317-9b0a-ac4ad4c6451e RealtimeClientConnectionTests test__034__Connection__ACK_and_NACK__ProtocolMessage__should_reset_msgSerial_serially_if_the_connection_does_not_resume() expected to equal <40012>, got <40160> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1139&StartingLineNumber=1139)
3e364e0a-e642-404a-b85f-00a5f4f5df95 c04a5534-6e53-49f5-b598-550bb4089dc6 RealtimeClientConnectionTests test__054__Connection__connection_request_fails__on_DISCONNECTED_after_CONNECTED__should_not_emit_error_with_a_renewable_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1923&StartingLineNumber=1923)
f159b1d0-985e-495a-85ba-a5bd8f3f3732 d461b7e0-3cb1-49ba-b6f4-7a85cd2f7681 RealtimeClientConnectionTests test__061__Connection__connection_request_fails__should_change_the_state_to_SUSPENDED_when_the_connection_state_has_been_in_the_DISCONNECTED_state_for_more_than_the_connectionStateTtl() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2265&StartingLineNumber=2265)
32cf822d-dffa-4d88-8653-9c670e556147 8a0dcaeb-fe47-495d-8269-63b823db2177 RealtimeClientConnectionTests test__066__Connection__connection_failures_once_CONNECTED__ACK_and_NACK_responses_for_published_messages_can_only_ever_be_received_on_the_transport_connection_on_which_those_messages_were_sent() Shouldn't be called (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2787&StartingLineNumber=2787)
bb5634f2-d5a1-49d5-ad28-43807bb05043 8bee007f-fc22-44f9-9ef4-2e1f4e2b476a RealtimeClientConnectionTests test__068__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client__and_no_error() expected to equal <VDU9_imPOi>, got <T6fmhFrICU> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2447&StartingLineNumber=2447)
278f2803-dadd-42ac-a0c1-61bf0d4af864 b2ea3eff-5e84-425d-947f-de001e3f7c3f RealtimeClientConnectionTests test__069__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client_and_an_non_fatal_error() expected to equal <rGTIeqR0_z>, got <B3ClNYC4qk> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2495&StartingLineNumber=2495)
926e630f-f7a3-4f6f-9c26-9fe39e72cdd4 e563b0c8-d19a-4f85-95d6-e104e15bf2d7 RealtimeClientConnectionTests test__070__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_a_new_connectionId_and_an_error() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2528&StartingLineNumber=2528)
ba0a6368-7b57-450c-90a5-8d685fbdfcbf 5b38c413-5707-4522-af8e-b9f76f441add RealtimeClientConnectionTests test__075__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_passed_since_last_activity__reattaches_to_the_same_channels_after_a_new_connection_has_been_established() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2853&StartingLineNumber=2853)
f8d63496-237f-4df6-9085-c8dc16fe3ee8 902857b0-ca0b-4d90-8165-f4ee2474cf7f RealtimeClientConnectionTests test__076__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_NOT_passed_since_last_activity__uses_the_same_connection() expected to equal <HUKZfHI3aZ>, got <9bWsi_WuEK> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2899&StartingLineNumber=2899)
c23db2c0-d2c5-44e5-a460-b9daa20988a2 3d3a2781-f9cc-42a5-9576-37b79fc2cc4f RealtimeClientConnectionTests test__082__Connection__Connection_recovery__when_a_connection_is_successfully_recovered__Connection_id_will_be_identical_to_the_id_of_the_connection_that_was_recovered_and_Connection_key_will_always_be_updated_to_the_ConnectionDetails_connectionKey_provided_in_the_first_CONNECTED_ProtocolMessage() expected to equal <ojpCJ8mZSO>, got <zSGTMj3PdB> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3101&StartingLineNumber=3101)
c02b9660-6712-4c33-baf7-57d1c8293ba2 e5b94fba-1e6f-411a-9356-68480d872058 RealtimeClientConnectionTests test__108__Connection__Operating_System_events_for_network_internet_connectivity_changes__re_authenticate_and_resume_the_connection_when_the_client_is_forcibly_disconnected_following_a_DISCONNECTED_message_containing_an_error_code_greater_than_or_equal_to_40140_and_less_than_40150() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=4256&StartingLineNumber=4256)
4451f028-9d75-4b2b-adb8-144baef80874 f03a47fa-2ca3-4d5d-a1f0-b922bba53d81 RealtimeClientPresenceTests test__023__Presence__Channel_state_change_side_effects__channel_enters_the_SUSPENDED_state__should_maintain_the_PresenceMap_and_any_members_present_before_and_after_the_sync_should_not_emit_presence_events() expected to have Array<ARTPresenceMessage> with count 3, got 4 Actual Value: [<ARTPresenceMessage: 0x7f9a1568b630> {id: yi1r4Ftd8K:0:0,clientId: tester,connectionId: yi1r4Ftd8K,timestamp: 2022-09-15 17:03:54 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f9a154ce610> {id: hSFjKCfwC8:2:0,clientId: user3,connectionId: hSFjKCfwC8,timestamp: 2022-09-15 17:03:54 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f9a154ce120> {id: hSFjKCfwC8:0:0,clientId: user1,connectionId: hSFjKCfwC8,timestamp: 2022-09-15 17:03:54 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f9a154ce540> {id: hSFjKCfwC8:1:0,clientId: user2,connectionId: hSFjKCfwC8,timestamp: 2022-09-15 17:03:54 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}] (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=787&StartingLineNumber=787)
6be602ed-8887-411e-9f8f-05ca92eedced 1a0d6474-285c-4fcb-8aba-438c3723ad7b RealtimeClientPresenceTests test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED() expected to be nil, got <Error 90001 - Unable to perform operation on channel: test-314--OSX-test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED-684954297.08662-CCBACDB9-B8EA-450F-97A7-22C862FB479F (not currently attached)> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=3039&StartingLineNumber=3039)
fac55b10-eee5-4664-b63a-e82f22e2c517 4ba6726c-a48c-46fa-85c2-31ee6db80716 RealtimeClientTests test__001__RealtimeClient__All_WebSocket_connections_should_include_the_current_API_version() expected to param <v=1.2> exists, got <key=_tmp_uezK1A.7M5Vgg:WA1tOKi1fMZSGdY_0UxmlXgrAT9x7cAM2jYttVedDo0&echo=true&agent=ably-cocoa/1.2.13%20macOS/10.15.7&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=51&StartingLineNumber=51)
a6359abc-35e9-4768-af9a-9b9d594428e9 da4d7d42-c79b-45fe-8d99-4ea6377fbabf RealtimeClientTests test__006__RealtimeClient__should_accept_acks_with_different_order() failed - 80018: Invalid connection serial (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
2f5bf252-9ee7-430f-8a03-c23f6fa6254c be9e53f7-9876-4494-b1df-4f4071258a94 RealtimeClientTests test__016__RealtimeClient__options__should_attempt_to_recover_the_connection_state_if_recover_string_is_assigned() failed - 40007: Unable to recover connection (requested connectionSerial is after the most recent one we could locate) (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
ccf5fe85-ae4d-4e50-bffc-2a9b2199bdaa e3b1b00c-fa5a-4e37-9ad9-e6ca8adad4e2 RealtimeClientTests test__037__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_SUSPENDED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1053&StartingLineNumber=1053)
abe5ea49-50d3-4fbe-a3e5-abdac7107447 c2b81ea2-d06c-41a7-b217-36a144da77e5 RealtimeClientTests test__039__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_DISCONNECTED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1163&StartingLineNumber=1163)
333026d4-a7a1-4221-b89a-5ab435fca6e0 a54428fb-682f-4f07-98b2-9c7ed614f0c3 RealtimeClientTests test__040__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_FAILED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1218&StartingLineNumber=1218)
6ba2713d-3142-4df4-b984-4c7936d1d425 3454ff51-e12f-4e5b-a328-1344bf55934b RestClientTests test__001__RestClient__All_REST_requests_should_include_the_current_API_version() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=156&StartingLineNumber=156)
bed1c16e-30e0-4ce9-852c-8f0ea6dac5c0 36841c8e-f199-458e-8fcc-867af1261a18 RestClientTests test__010__RestClient__X_Ably_Version_must_be_included_in_all_REST_requests() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1648&StartingLineNumber=1648)