Details of upload 53678501-d83f-47e0-baf8-c52e02a1a762

Created at
2022-09-14T17:25:32.356Z
Total number of tests
804
JUnit report XML
View report
GitHub repository
ably/ably-cocoa
Commit SHA
a29827a
Pull request base ref
main
Pull request head ref
integration/no_connection_time_serial
Branch / tag name
1496/merge
Workflow asset retention period
90 days
GitHub action
__run_5
GitHub run ID
3054672642
GitHub run attempt
1
GitHub run number
237
GitHub job
check
GitHub job URL
Not known
Loop iteration
1

Test failures

There are 23 failures in this upload.

Failure ID Test case ID Test class Test case Message
fcbc8381-3bdc-4074-ac59-98983fcd8235 181c0d92-7356-4faf-acd0-7cc9b78a0aa2 AuthTests test__148__JWT_and_realtime__when_token_expires_and_has_a_means_to_renew__reconnects_using_authCallback_and_obtains_a_new_token() expected to equal <h9lIFdt-gb>, got <rFu3Qiz8SC> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/AuthTests.swift#CharacterRangeLen=0&EndingLineNumber=4180&StartingLineNumber=4180)
1fa77cbe-0803-4f5f-a57b-14e690214584 1cf86794-ca47-4832-a5b5-2c9cc8f9586f RealtimeClientChannelTests test__011__Channel__EventEmitter__channel_states_and_events__ChannelStateChange_will_contain_a_resumed_boolean_attribute_with_value__true__if_the_bit_flag_RESUMED_was_included() expected to be true, got <false> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=524&StartingLineNumber=524)
d74f24a3-9006-4338-92af-a328d44bf93e 896d48fd-c709-4e4a-9b12-bcd9504dd99f RealtimeClientConnectionTests test__003__Connection__API_version_param_must_be_included_in_all_connections() expected to param <v=1.2> exists, got <key=_tmp_lVFJzA.1nlEnA:dZ1X_sVkvHAFubxSRyMvjSLBSAYaNgb0z9rFQLFvdxM&echo=true&agent=ably-cocoa/1.2.13%20tvOS/14.3.0&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=351&StartingLineNumber=351)
b4cf02d1-aa60-4e45-8766-6de68affd5ff 89889c54-8d41-4c49-a967-c0c1f051c5e6 RealtimeClientConnectionTests test__033__Connection__ACK_and_NACK__ProtocolMessage__should_continue_incrementing_msgSerial_serially_if_the_connection_resumes_successfully() expected to equal <5>, got <0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1068&StartingLineNumber=1068)
16699fb3-43a3-4b35-b215-4f2e62bbffed c04a5534-6e53-49f5-b598-550bb4089dc6 RealtimeClientConnectionTests test__054__Connection__connection_request_fails__on_DISCONNECTED_after_CONNECTED__should_not_emit_error_with_a_renewable_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1923&StartingLineNumber=1923)
5cb4cad4-c246-41fe-8d3a-1143f6356690 d461b7e0-3cb1-49ba-b6f4-7a85cd2f7681 RealtimeClientConnectionTests test__061__Connection__connection_request_fails__should_change_the_state_to_SUSPENDED_when_the_connection_state_has_been_in_the_DISCONNECTED_state_for_more_than_the_connectionStateTtl() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2265&StartingLineNumber=2265)
666b9ff0-9224-48dc-a917-1f35d00acc80 8a0dcaeb-fe47-495d-8269-63b823db2177 RealtimeClientConnectionTests test__066__Connection__connection_failures_once_CONNECTED__ACK_and_NACK_responses_for_published_messages_can_only_ever_be_received_on_the_transport_connection_on_which_those_messages_were_sent() Shouldn't be called (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2787&StartingLineNumber=2787)
be7c5e2f-bba3-4937-bf5a-4c32731d41d4 8bee007f-fc22-44f9-9ef4-2e1f4e2b476a RealtimeClientConnectionTests test__068__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client__and_no_error() expected to equal <vPsC7MDGdG>, got <QFx5wFIcgw> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2447&StartingLineNumber=2447)
53079388-253f-4d36-be20-07e103a7e399 b2ea3eff-5e84-425d-947f-de001e3f7c3f RealtimeClientConnectionTests test__069__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client_and_an_non_fatal_error() expected to equal <vwe8cbDDa3>, got <TZDY0L5vwx> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2495&StartingLineNumber=2495)
85405a64-83f6-4a50-9231-0c5e771e397d 902857b0-ca0b-4d90-8165-f4ee2474cf7f RealtimeClientConnectionTests test__076__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_NOT_passed_since_last_activity__uses_the_same_connection() expected to equal <X6fjphcuIH>, got <uiJNXoGDJt> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2899&StartingLineNumber=2899)
ed3e19dd-1bf1-4871-92aa-71cc2b102b6e 3d3a2781-f9cc-42a5-9576-37b79fc2cc4f RealtimeClientConnectionTests test__082__Connection__Connection_recovery__when_a_connection_is_successfully_recovered__Connection_id_will_be_identical_to_the_id_of_the_connection_that_was_recovered_and_Connection_key_will_always_be_updated_to_the_ConnectionDetails_connectionKey_provided_in_the_first_CONNECTED_ProtocolMessage() expected to equal <IQyMVnzoWC>, got <ksZmGk7PMF> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3101&StartingLineNumber=3101)
e612d9d9-a1f5-4fea-bd88-3b30d7e496d1 e5b94fba-1e6f-411a-9356-68480d872058 RealtimeClientConnectionTests test__108__Connection__Operating_System_events_for_network_internet_connectivity_changes__re_authenticate_and_resume_the_connection_when_the_client_is_forcibly_disconnected_following_a_DISCONNECTED_message_containing_an_error_code_greater_than_or_equal_to_40140_and_less_than_40150() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=4256&StartingLineNumber=4256)
80222d8f-2250-4eca-86d2-1652eed00084 f03a47fa-2ca3-4d5d-a1f0-b922bba53d81 RealtimeClientPresenceTests test__023__Presence__Channel_state_change_side_effects__channel_enters_the_SUSPENDED_state__should_maintain_the_PresenceMap_and_any_members_present_before_and_after_the_sync_should_not_emit_presence_events() expected to have Array<ARTPresenceMessage> with count 3, got 4 Actual Value: [<ARTPresenceMessage: 0x7fd7751d39f0> {id: mkzTtuValY:0:0,clientId: tester,connectionId: mkzTtuValY,timestamp: 2022-09-14 17:17:46 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7fd774978600> {id: n6osazLqvu:2:0,clientId: user3,connectionId: n6osazLqvu,timestamp: 2022-09-14 17:17:45 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7fd775255970> {id: n6osazLqvu:0:0,clientId: user1,connectionId: n6osazLqvu,timestamp: 2022-09-14 17:17:45 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7fd7752aa9a0> {id: n6osazLqvu:1:0,clientId: user2,connectionId: n6osazLqvu,timestamp: 2022-09-14 17:17:45 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}] (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=787&StartingLineNumber=787)
d4e51563-7bb7-4449-a9c3-260a7528f750 1a0d6474-285c-4fcb-8aba-438c3723ad7b RealtimeClientPresenceTests test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED() expected to be nil, got <Error 90001 - Unable to perform operation on channel: test-437--tvOS-test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED-684868751.109738-4193C727-A7FF-4C75-B336-9B2E9E6D59BE (not currently attached)> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=3039&StartingLineNumber=3039)
a8650803-6b99-4e8c-9dba-6b12012ee219 4ba6726c-a48c-46fa-85c2-31ee6db80716 RealtimeClientTests test__001__RealtimeClient__All_WebSocket_connections_should_include_the_current_API_version() expected to param <v=1.2> exists, got <key=_tmp_lVFJzA.1nlEnA:dZ1X_sVkvHAFubxSRyMvjSLBSAYaNgb0z9rFQLFvdxM&echo=true&agent=ably-cocoa/1.2.13%20tvOS/14.3.0&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=51&StartingLineNumber=51)
7dcfa397-95ee-4111-b475-126e79adb51d da4d7d42-c79b-45fe-8d99-4ea6377fbabf RealtimeClientTests test__006__RealtimeClient__should_accept_acks_with_different_order() failed - 80018: Invalid connection serial (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
1bd4e1fa-1d6a-4f7d-b6e3-2d642ec31527 be9e53f7-9876-4494-b1df-4f4071258a94 RealtimeClientTests test__016__RealtimeClient__options__should_attempt_to_recover_the_connection_state_if_recover_string_is_assigned() failed - 40007: Unable to recover connection (requested connectionSerial is after the most recent one we could locate) (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
243b22cc-72da-4607-a6e0-8095db7fc028 e3b1b00c-fa5a-4e37-9ad9-e6ca8adad4e2 RealtimeClientTests test__037__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_SUSPENDED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1053&StartingLineNumber=1053)
f0042011-ec28-441c-9441-0d4ec6d9dae0 a54428fb-682f-4f07-98b2-9c7ed614f0c3 RealtimeClientTests test__040__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_FAILED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1218&StartingLineNumber=1218)
af0547a7-6e91-449f-97da-002d29d29778 5c5a4bee-8a29-49ca-baed-cf21480fa671 RestClientChannelTests test__047__status__with_subscribers__returns_a_channel_details_object_populated_with_channel_metrics() expected to equal <1>, got <0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=1517&StartingLineNumber=1517)
f38daa1c-ce63-4926-bad6-1b1931fa17fb d17ec17b-78b4-4e1d-a0d3-2dba60cc50f6 RestClientStatsTests test__002__RestClient__stats__result__should_match_hour_level_inbound_and_outbound_fixture_data__forwards_() Crash: xctest (8891): Namespace SIGNAL, Code 0x4 (#CharacterRangeLen=0)
34cbd0b1-501c-4850-b34b-e1e2fc7d3d68 3454ff51-e12f-4e5b-a328-1344bf55934b RestClientTests test__001__RestClient__All_REST_requests_should_include_the_current_API_version() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=156&StartingLineNumber=156)
7296f9e5-3dbe-4508-8cc3-d51314694522 36841c8e-f199-458e-8fcc-867af1261a18 RestClientTests test__010__RestClient__X_Ably_Version_must_be_included_in_all_REST_requests() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1648&StartingLineNumber=1648)