Details of upload 8bd8f354-081c-4f38-bdeb-ec388fb2ee73

Created at
2022-09-26T16:22:56.534Z
Total number of tests
803
JUnit report XML
View report
GitHub repository
ably/ably-cocoa
Commit SHA
b680d0b
Pull request base ref
integration/no_connection_time_serial
Pull request head ref
integration/no_connection_time_serial-tests
Branch / tag name
1505/merge
Workflow asset retention period
90 days
GitHub action
__run_5
GitHub run ID
3129265284
GitHub run attempt
1
GitHub run number
254
GitHub job
check
GitHub job URL
Not known
Loop iteration
1

Test failures

There are 18 failures in this upload.

Failure ID Test case ID Test class Test case Message
a1081854-1b6d-44bd-ba8b-d8d2782b0a2e 181c0d92-7356-4faf-acd0-7cc9b78a0aa2 AuthTests test__148__JWT_and_realtime__when_token_expires_and_has_a_means_to_renew__reconnects_using_authCallback_and_obtains_a_new_token() expected to equal <slJn3NUfEF>, got <Iy6IN-NSfC> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/AuthTests.swift#CharacterRangeLen=0&EndingLineNumber=4180&StartingLineNumber=4180)
50947e23-a298-4fb8-a82b-ef8462593f6c 1cf86794-ca47-4832-a5b5-2c9cc8f9586f RealtimeClientChannelTests test__011__Channel__EventEmitter__channel_states_and_events__ChannelStateChange_will_contain_a_resumed_boolean_attribute_with_value__true__if_the_bit_flag_RESUMED_was_included() expected to be true, got <false> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=524&StartingLineNumber=524)
04725abc-d26d-4684-9444-8470fcc222ba 93a1358c-cd03-42d7-95d4-ae5a59ec8b82 RealtimeClientChannelTests test__021__Channel__connection_state__changes_to_FAILED__should_keep_the_channels_attached_when_client_reconnected_successfully_and_queue_messages_is_disabled() expected to equal <Attached>, got <Attaching> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=743&StartingLineNumber=743)
27922ffc-00c0-4743-8117-cacfbf71a463 89889c54-8d41-4c49-a967-c0c1f051c5e6 RealtimeClientConnectionTests test__033__Connection__ACK_and_NACK__ProtocolMessage__should_continue_incrementing_msgSerial_serially_if_the_connection_resumes_successfully() expected to equal <5>, got <0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1068&StartingLineNumber=1068)
5b870a5b-b649-433a-84df-8d3abfc2d6de 4e71277a-67db-4317-9b0a-ac4ad4c6451e RealtimeClientConnectionTests test__034__Connection__ACK_and_NACK__ProtocolMessage__should_reset_msgSerial_serially_if_the_connection_does_not_resume() expected to equal <40012>, got <40160> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1139&StartingLineNumber=1139)
5151afa1-8399-4039-b856-ef04aa129e36 8bee007f-fc22-44f9-9ef4-2e1f4e2b476a RealtimeClientConnectionTests test__068__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client__and_no_error() expected to equal <yipRdk_LIo>, got <Tw3FnYmB9q> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2446&StartingLineNumber=2446)
9efa163c-aa58-4cb4-a8e7-4f0bf7443f0d 902857b0-ca0b-4d90-8165-f4ee2474cf7f RealtimeClientConnectionTests test__076__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_NOT_passed_since_last_activity__uses_the_same_connection() expected to equal <pN5TFstc9K>, got <teyrU3GGXp> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2858&StartingLineNumber=2858)
67404ece-57e5-4722-8210-1d6e83ba870b a71fb8e3-d256-437e-967a-023616848090 RealtimeClientConnectionTests test__080__Connection__Connection_recovery__connection_state_should_recover_explicitly_with_a_recover_key() -[__NSCFString channelSerial]: unrecognized selector sent to instance 0x7f9d5a38bb40 (NSInvalidArgumentException) (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3017&StartingLineNumber=3017)
3d669e45-4605-491b-9720-f6d2c2e3a066 3d3a2781-f9cc-42a5-9576-37b79fc2cc4f RealtimeClientConnectionTests test__082__Connection__Connection_recovery__when_a_connection_is_successfully_recovered__Connection_id_will_be_identical_to_the_id_of_the_connection_that_was_recovered_and_Connection_key_will_always_be_updated_to_the_ConnectionDetails_connectionKey_provided_in_the_first_CONNECTED_ProtocolMessage() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3055&StartingLineNumber=3055)
cdb9806f-e566-441f-a676-d98cdfd45bad a2f31bbe-c51b-4824-b1fa-73ee201f13e9 RealtimeClientConnectionTests test__084__Connection__Connection_recovery__should_connect_anyway_if_the_recoverKey_is_no_longer_valid() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3091&StartingLineNumber=3091)
a69f2d46-e82a-4adb-af5f-1f94e1f62de9 91216771-9471-49dd-aa8c-4709523a4d2d RealtimeClientConnectionTests test__085__Connection__Connection_recovery__should_use_msgSerial_from_recoveryKey_to_set_the_client_internal_msgSerial_but_is_not_sent_to_Ably() expected to equal <7>, got <0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3147&StartingLineNumber=3147)
3ab2547e-e3b4-43d3-974a-424736cd46fb e5b94fba-1e6f-411a-9356-68480d872058 RealtimeClientConnectionTests test__108__Connection__Operating_System_events_for_network_internet_connectivity_changes__re_authenticate_and_resume_the_connection_when_the_client_is_forcibly_disconnected_following_a_DISCONNECTED_message_containing_an_error_code_greater_than_or_equal_to_40140_and_less_than_40150() expected to equal <pRijldNSLX>, got <y1wxo7Lbwj> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=4221&StartingLineNumber=4221)
d7938ea6-e6bc-4ff8-acdb-bccc76c8af66 f03a47fa-2ca3-4d5d-a1f0-b922bba53d81 RealtimeClientPresenceTests test__023__Presence__Channel_state_change_side_effects__channel_enters_the_SUSPENDED_state__should_maintain_the_PresenceMap_and_any_members_present_before_and_after_the_sync_should_not_emit_presence_events() Crash: xctest (10102): <external symbol> (#CharacterRangeLen=0)
957f938c-804d-4d56-b44c-95f9b0827946 1a0d6474-285c-4fcb-8aba-438c3723ad7b RealtimeClientPresenceTests test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED() expected to be nil, got <Error 90001 - Unable to perform operation on channel: test-53--tvOS-test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED-685901871.817876-C652D074-2212-496D-95EE-E66E11F120C9 (not currently attached)> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=3039&StartingLineNumber=3039)
22917281-5ef0-44ae-8b8a-cc9f78f1a660 4ba6726c-a48c-46fa-85c2-31ee6db80716 RealtimeClientTests test__001__RealtimeClient__All_WebSocket_connections_should_include_the_current_API_version() expected to param <v=1.2> exists, got <key=_tmp_0nnYsQ.AZ25LQ:eNUXgXpQxWvohn2RKkgQ_3nE6spxLUMnHlamCZsTmSI&echo=true&agent=ably-cocoa/1.2.13%20tvOS/14.3.0&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=51&StartingLineNumber=51)
bc1a49b1-1e59-40e9-a0eb-77d4b46a2b45 be9e53f7-9876-4494-b1df-4f4071258a94 RealtimeClientTests test__016__RealtimeClient__options__should_attempt_to_recover_the_connection_state_if_recover_string_is_assigned() recoveryKey wrong formed expected to equal <e7dnm9AdQBGHdt!JAzNoWDPPXDxT2Yp-2232e7dnm9AdQBGHdt:0>, got <{"serials":{},"connectionKey":"e7dnm9AdQBGHdt!JAzNoWDPPXDxT2Yp-2232e7dnm9AdQBGHdt","msgSerial":0}> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=116&StartingLineNumber=116)
1fcddc3d-fba4-4baa-976b-5b92c3eb243a 3454ff51-e12f-4e5b-a328-1344bf55934b RestClientTests test__001__RestClient__All_REST_requests_should_include_the_current_API_version() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=156&StartingLineNumber=156)
f84ae065-25d0-41df-b245-d4219eb03d78 36841c8e-f199-458e-8fcc-867af1261a18 RestClientTests test__010__RestClient__X_Ably_Version_must_be_included_in_all_REST_requests() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1648&StartingLineNumber=1648)