Details of upload e71f05d7-c4c7-423d-b05a-0201ccf77b59

Created at
2022-09-15T14:14:25.768Z
Total number of tests
804
JUnit report XML
View report
GitHub repository
ably/ably-cocoa
Commit SHA
432bd6e
Pull request base ref
main
Pull request head ref
integration/no_connection_time_serial
Branch / tag name
1496/merge
Workflow asset retention period
90 days
GitHub action
__run_5
GitHub run ID
3061029557
GitHub run attempt
1
GitHub run number
238
GitHub job
check
GitHub job URL
Not known
Loop iteration
1

Test failures

There are 24 failures in this upload.

Failure ID Test case ID Test class Test case Message
1e60e3ed-04a0-4244-b53c-b9f0b3424a9d 181c0d92-7356-4faf-acd0-7cc9b78a0aa2 AuthTests test__148__JWT_and_realtime__when_token_expires_and_has_a_means_to_renew__reconnects_using_authCallback_and_obtains_a_new_token() expected to equal <iLTomf0Zaa>, got <KdWJdSmFcZ> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/AuthTests.swift#CharacterRangeLen=0&EndingLineNumber=4180&StartingLineNumber=4180)
e90316d7-a1d6-491c-b89b-14c5f093e777 1cf86794-ca47-4832-a5b5-2c9cc8f9586f RealtimeClientChannelTests test__011__Channel__EventEmitter__channel_states_and_events__ChannelStateChange_will_contain_a_resumed_boolean_attribute_with_value__true__if_the_bit_flag_RESUMED_was_included() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=506&StartingLineNumber=506)
bf27fb45-d3bf-43e8-80ee-24c71fc7b016 896d48fd-c709-4e4a-9b12-bcd9504dd99f RealtimeClientConnectionTests test__003__Connection__API_version_param_must_be_included_in_all_connections() expected to param <v=1.2> exists, got <key=_tmp_GjRmvg.um5ChQ:Lpp6bxgTwUodv3wqndmFSCaUGIKFJVf_YmediqgnpTs&echo=true&agent=ably-cocoa/1.2.13%20tvOS/14.3.0&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=351&StartingLineNumber=351)
863e4c29-12aa-4bd5-a486-d1e5aa12c5c2 89889c54-8d41-4c49-a967-c0c1f051c5e6 RealtimeClientConnectionTests test__033__Connection__ACK_and_NACK__ProtocolMessage__should_continue_incrementing_msgSerial_serially_if_the_connection_resumes_successfully() expected to equal <5>, got <0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1068&StartingLineNumber=1068)
297a0d67-9bbe-4c72-b14c-134f4f99707b 4e71277a-67db-4317-9b0a-ac4ad4c6451e RealtimeClientConnectionTests test__034__Connection__ACK_and_NACK__ProtocolMessage__should_reset_msgSerial_serially_if_the_connection_does_not_resume() expected to equal <40012>, got <90001> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1139&StartingLineNumber=1139)
6a2f1c01-e6d4-4f77-9926-99d6fd480a33 c04a5534-6e53-49f5-b598-550bb4089dc6 RealtimeClientConnectionTests test__054__Connection__connection_request_fails__on_DISCONNECTED_after_CONNECTED__should_not_emit_error_with_a_renewable_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1923&StartingLineNumber=1923)
e10996cc-2596-4074-aa7f-8b9d6c3b63e2 d461b7e0-3cb1-49ba-b6f4-7a85cd2f7681 RealtimeClientConnectionTests test__061__Connection__connection_request_fails__should_change_the_state_to_SUSPENDED_when_the_connection_state_has_been_in_the_DISCONNECTED_state_for_more_than_the_connectionStateTtl() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2265&StartingLineNumber=2265)
e07702b8-fc86-4400-9efd-8895a336360b 8a0dcaeb-fe47-495d-8269-63b823db2177 RealtimeClientConnectionTests test__066__Connection__connection_failures_once_CONNECTED__ACK_and_NACK_responses_for_published_messages_can_only_ever_be_received_on_the_transport_connection_on_which_those_messages_were_sent() Shouldn't be called (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2787&StartingLineNumber=2787)
4e02c810-2aba-4cb6-9834-56759ab496ce 8bee007f-fc22-44f9-9ef4-2e1f4e2b476a RealtimeClientConnectionTests test__068__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client__and_no_error() expected to equal <qhNYJ28Wij>, got <3pxu0fIWHG> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2447&StartingLineNumber=2447)
23002fe4-f36d-466f-83ae-d1f9f46d370e b2ea3eff-5e84-425d-947f-de001e3f7c3f RealtimeClientConnectionTests test__069__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client_and_an_non_fatal_error() expected to equal <StA15EirMe>, got <4JaUw8yRpj> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2495&StartingLineNumber=2495)
c10e6a8b-7ac6-4487-bd70-617a7f5f3604 e563b0c8-d19a-4f85-95d6-e104e15bf2d7 RealtimeClientConnectionTests test__070__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_a_new_connectionId_and_an_error() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2528&StartingLineNumber=2528)
bfa48388-2869-45f4-a3bc-4adda72b0258 5b38c413-5707-4522-af8e-b9f76f441add RealtimeClientConnectionTests test__075__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_passed_since_last_activity__reattaches_to_the_same_channels_after_a_new_connection_has_been_established() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2853&StartingLineNumber=2853)
28bdb42b-d8f2-46cf-819f-fb9a73258736 902857b0-ca0b-4d90-8165-f4ee2474cf7f RealtimeClientConnectionTests test__076__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_NOT_passed_since_last_activity__uses_the_same_connection() expected to equal <wErpDten52>, got <8eamq8Qczr> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2899&StartingLineNumber=2899)
87b69cd6-d106-491d-bfbd-688d748417cb 3d3a2781-f9cc-42a5-9576-37b79fc2cc4f RealtimeClientConnectionTests test__082__Connection__Connection_recovery__when_a_connection_is_successfully_recovered__Connection_id_will_be_identical_to_the_id_of_the_connection_that_was_recovered_and_Connection_key_will_always_be_updated_to_the_ConnectionDetails_connectionKey_provided_in_the_first_CONNECTED_ProtocolMessage() expected to equal <ovFzc1ENYK>, got <uZgeLwcgnA> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3101&StartingLineNumber=3101)
345f0fc3-4849-4ef0-9778-fb5854511a51 e5b94fba-1e6f-411a-9356-68480d872058 RealtimeClientConnectionTests test__108__Connection__Operating_System_events_for_network_internet_connectivity_changes__re_authenticate_and_resume_the_connection_when_the_client_is_forcibly_disconnected_following_a_DISCONNECTED_message_containing_an_error_code_greater_than_or_equal_to_40140_and_less_than_40150() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=4256&StartingLineNumber=4256)
48159d71-73cd-4bcd-a873-eadf05435589 f03a47fa-2ca3-4d5d-a1f0-b922bba53d81 RealtimeClientPresenceTests test__023__Presence__Channel_state_change_side_effects__channel_enters_the_SUSPENDED_state__should_maintain_the_PresenceMap_and_any_members_present_before_and_after_the_sync_should_not_emit_presence_events() expected to have Array<ARTPresenceMessage> with count 3, got 4 Actual Value: [<ARTPresenceMessage: 0x7fb306c7cdd0> {id: YCkOcbwpTV:2:0,clientId: user3,connectionId: YCkOcbwpTV,timestamp: 2022-09-15 14:08:01 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7fb30681deb0> {id: YCkOcbwpTV:0:0,clientId: user1,connectionId: YCkOcbwpTV,timestamp: 2022-09-15 14:08:01 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7fb306c75560> {id: YCkOcbwpTV:1:0,clientId: user2,connectionId: YCkOcbwpTV,timestamp: 2022-09-15 14:08:01 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7fb3069b5c40> {id: 3wFgRUhYxa:0:0,clientId: tester,connectionId: 3wFgRUhYxa,timestamp: 2022-09-15 14:08:02 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}] (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=787&StartingLineNumber=787)
29abbc47-c0fc-447c-a69a-3781db5710eb 1a0d6474-285c-4fcb-8aba-438c3723ad7b RealtimeClientPresenceTests test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED() expected to be nil, got <Error 90001 - Unable to perform operation on channel: test-437--tvOS-test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED-684943762.432812-496CC6F4-EB85-46D0-90F2-B9D1671E8619 (not currently attached)> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=3039&StartingLineNumber=3039)
b1378d59-f03e-4c8e-9def-a94ea21f0039 4ba6726c-a48c-46fa-85c2-31ee6db80716 RealtimeClientTests test__001__RealtimeClient__All_WebSocket_connections_should_include_the_current_API_version() expected to param <v=1.2> exists, got <key=_tmp_GjRmvg.um5ChQ:Lpp6bxgTwUodv3wqndmFSCaUGIKFJVf_YmediqgnpTs&echo=true&agent=ably-cocoa/1.2.13%20tvOS/14.3.0&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=51&StartingLineNumber=51)
a0048e27-dab4-4b28-9dc3-03e78849f103 da4d7d42-c79b-45fe-8d99-4ea6377fbabf RealtimeClientTests test__006__RealtimeClient__should_accept_acks_with_different_order() failed - 80018: Invalid connection serial (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
718edd30-ab9b-4ba5-9232-56e50f94750b be9e53f7-9876-4494-b1df-4f4071258a94 RealtimeClientTests test__016__RealtimeClient__options__should_attempt_to_recover_the_connection_state_if_recover_string_is_assigned() failed - 40007: Unable to recover connection (requested connectionSerial is after the most recent one we could locate) (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
8f4bcc1e-fbdc-45e2-a5aa-bcdd333e6dd8 e3b1b00c-fa5a-4e37-9ad9-e6ca8adad4e2 RealtimeClientTests test__037__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_SUSPENDED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1053&StartingLineNumber=1053)
2b8da9d0-bab1-490f-a6c4-b1a1f9c15b0c a54428fb-682f-4f07-98b2-9c7ed614f0c3 RealtimeClientTests test__040__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_FAILED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1218&StartingLineNumber=1218)
f5cb4d7e-378a-4d0c-bf23-e5cfc72d7658 3454ff51-e12f-4e5b-a328-1344bf55934b RestClientTests test__001__RestClient__All_REST_requests_should_include_the_current_API_version() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=156&StartingLineNumber=156)
21da9bd8-f34c-4f36-826e-19ea012593b2 36841c8e-f199-458e-8fcc-867af1261a18 RestClientTests test__010__RestClient__X_Ably_Version_must_be_included_in_all_REST_requests() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1648&StartingLineNumber=1648)