Sep 10 17:13:51 devstack cinder-volume[74822]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 17:13:51 devstack cinder-volume[74822]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 17:13:51 devstack cinder-volume[74822]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 17:13:53 devstack cinder-volume[74822]: INFO dbcounter [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Registered counter for database cinder Sep 10 17:13:53 devstack cinder-volume[74822]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:13:53 devstack cinder-volume[74822]: DEBUG dbcounter [-] [74822] Writer thread running {{(pid=74822) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 17:13:53 devstack cinder-volume[74822]: INFO cinder.rpc [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 17:13:53 devstack cinder-volume[74822]: INFO cinder.rpc [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 17:13:53 devstack cinder-volume[74822]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:13:54 devstack cinder-volume[74822]: INFO cinder.volume.manager [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Determined volume DB was empty at startup. Sep 10 17:13:54 devstack cinder-volume[74822]: DEBUG cinder.volume.manager [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74822) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 10 17:13:54 devstack cinder-volume[74822]: INFO cinder.volume.manager [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 17:13:54 devstack cinder-volume[74822]: WARNING stevedore.named [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 17:13:54 devstack cinder-volume[74822]: WARNING castellan.key_manager [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 17:13:54 devstack cinder-volume[74822]: WARNING cinder.keymgr.conf_key_mgr [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 17:13:54 devstack cinder-volume[74822]: DEBUG cinder.volume.drivers.lvm [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74822) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 10 17:13:54 devstack cinder-volume[74822]: DEBUG oslo_concurrency.processutils [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74822) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:13:55 devstack cinder-volume[74822]: DEBUG oslo_concurrency.processutils [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] CMD "cinder-rtstool verify" returned: 0 in 1.236s {{(pid=74822) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:13:55 devstack cinder-volume[74822]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:13:55 devstack cinder-volume[74822]: INFO cinder.rpc [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 10 17:13:55 devstack cinder-volume[74822]: INFO cinder.rpc [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 10 17:13:55 devstack cinder-volume[74822]: WARNING stevedore.named [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 17:13:55 devstack cinder-volume[74822]: WARNING castellan.key_manager [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 17:13:55 devstack cinder-volume[74822]: INFO cinder.volume.manager [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 10 17:13:55 devstack cinder-volume[74822]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:13:56 devstack cinder-volume[74822]: INFO oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Starting 1 workers Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Started child 74956 {{(pid=74822) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Full set of CONF: {{(pid=74822) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] ******************************************************************************** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Configuration options gathered from: {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] ================================================================================ {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] allow_availability_zone_fallback = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] allow_compression_on_image_upload = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] allowed_direct_url_schemes = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] api_rate_limit = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] auth_strategy = keystone {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] az_cache_duration = 3600 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_availability_zone = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_host = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_stats_polling_interval = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backup_api_class = cinder.backup.api.API {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backup_name_template = backup-%s {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backup_use_same_host = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backup_use_temp_snapshot = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74956]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] chap_password = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] chap_username = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_internal_tenant_project_id = 373393203b204c2aa9d106bcd69e6ff0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_internal_tenant_user_id = e7a88c1b31e641c19724c9fb1ed33205 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cloned_volume_same_az = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cluster = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] compression_format = gzip {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] compute_api_class = cinder.compute.nova.API {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] config_dir = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] config_source = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] control_exchange = openstack {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] debug = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] default_availability_zone = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] default_group_type = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] default_volume_type = lvmdriver-1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] driver_client_cert = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] driver_client_cert_key = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] driver_data_namespace = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] driver_ssl_cert_path = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] driver_ssl_cert_verify = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] driver_use_ssl = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] enable_force_upload = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] enable_new_services = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] enable_unsupported_driver = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] enabled_backends = ['lvmdriver-1'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] enforce_multipath_for_image_xfer = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] filter_function = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_api_insecure = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_api_servers = ['http://192.168.122.66/image'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_api_ssl_compression = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_ca_certificates_file = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_catalog_info = image:glance:publicURL {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_certfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_keyfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_num_retries = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] glance_request_timeout = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] goodness_function = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] graceful_shutdown_timeout = 5 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] group_api_class = cinder.group.api.API {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] host = devstack {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_compress_on_upload = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_conversion_address_space_limit = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_conversion_cpu_limit = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_conversion_disable = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_upload_use_cinder_backend = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_upload_use_internal_tenant = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_volume_cache_enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_volume_cache_max_count = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] image_volume_cache_max_size_gb = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] init_host_max_objects_retrieval = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] instance_format = [instance: %(uuid)s] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] iscsi_iotype = fileio {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] iscsi_target_flags = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] iscsi_write_cache = on {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] iser_helper = tgtadm {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] iser_ip_address = 192.168.122.66 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] iser_port = 3260 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_color = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_config_append = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_dir = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_file = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_options = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_rotate_interval = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_rotate_interval_type = days {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] log_rotation_type = none {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] max_age = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] max_logfile_count = 30 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] max_logfile_size_mb = 200 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] max_over_subscription_ratio = 20.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] message_reap_interval = 86400 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] message_ttl = 2592000 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] migration_create_volume_timeout_secs = 300 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] monkey_patch = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] monkey_patch_modules = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] my_ip = 192.168.122.66 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] no_snapshot_gb_quota = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] num_iser_scan_tries = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] num_shell_tries = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] num_volume_device_scan_tries = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] nvmeof_conn_info_version = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] nvmet_ns_id = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] nvmet_port_id = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] osapi_max_limit = 1000 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] osapi_volume_ext_list = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] osapi_volume_listen = 0.0.0.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] osapi_volume_listen_port = 8776 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] osapi_volume_use_ssl = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] osapi_volume_workers = 2 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] per_volume_size_limit = -1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] periodic_fuzzy_delay = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] periodic_interval = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] project_id_regex = [0-9a-f\-]+ {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] public_endpoint = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] publish_errors = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] quota_backup_gigabytes = 1000 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] quota_backups = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] quota_gigabytes = 1000 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] quota_groups = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] quota_snapshots = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] quota_volumes = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] rate_limit_burst = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] rate_limit_except_level = CRITICAL {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] rate_limit_interval = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] reinit_driver_count = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] replication_device = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] report_discard_supported = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] report_interval = 120 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] reservation_clean_interval = 86400 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] reservation_expire = 86400 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] reserved_image_namespaces = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] reserved_percentage = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] rpc_response_timeout = 120 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] run_external_periodic_tasks = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] scst_target_driver = iscsi {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] scst_target_iqn_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_down_time = 720 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] shell_completion = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] snapshot_name_template = snapshot-%s {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] snapshot_same_host = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] split_loggers = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] state_path = /opt/stack/data/cinder {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] storage_availability_zone = nova {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] storage_protocol = iSCSI {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] syslog_log_facility = LOG_USER {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] target_helper = lioadm {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] target_ip_address = 192.168.122.66 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] target_port = 3260 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] target_protocol = iscsi {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] target_secondary_ip_addresses = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] trace_flags = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] transfer_api_class = cinder.transfer.api.API {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] transport_url = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] until_refresh = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] use_chap_auth = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] use_default_quota_class = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] use_journal = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] use_json = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] use_multipath_for_image_xfer = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] use_stderr = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] use_syslog = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] verify_glance_signatures = enabled {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_api_class = cinder.volume.api.API {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_backend_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_clear = zero {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_clear_ionice = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_clear_size = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_copy_bps_limit = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_dd_blocksize = 1M {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_name_template = volume-%s {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_service_inithost_offload = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volume_usage_audit_period = month {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] watch_log_file = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] zoning_mode = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_concurrency.disable_process_locking = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.admin_password = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.admin_token = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.admin_user = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.auth_admin_prefix = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.auth_port = 35357 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.auth_protocol = https {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.auth_section = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.auth_type = password {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.auth_uri = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.auth_version = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.cache = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.certfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.delay_auth_decision = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.http_connect_timeout = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.identity_uri = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.include_service_catalog = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.insecure = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.interface = public {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.keyfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_password = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcache_username = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.region_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.service_token_roles_required = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.service_type = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.token_cache_time = 300 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] keystone_authtoken.www_authenticate_uri = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.backend = dogpile.cache.null {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.backend_argument = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.backend_expiration_time = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.config_prefix = cache.oslo {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.dead_timeout = 60.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.debug_cache_backend = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.enable_retry_client = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.enable_socket_keepalive = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.enforce_fips_mode = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.expiration_time = 600 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.hashclient_retry_attempts = 2 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.hashclient_retry_delay = 1.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_dead_retry = 300 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_password = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_pool_maxsize = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_sasl_enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_socket_timeout = 1.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.memcache_username = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.proxies = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.redis_db = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.redis_password = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.redis_sentinel_service_name = mymaster {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.redis_server = localhost:6379 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.redis_socket_timeout = 1.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.redis_username = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.retry_attempts = 2 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.retry_delay = 0.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.socket_keepalive_count = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.socket_keepalive_idle = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.socket_keepalive_interval = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.tls_allowed_ciphers = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.tls_cafile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.tls_certfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.tls_enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cache.tls_keyfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] coordination.backend_url = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.asyncio_connection = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.asyncio_slave_connection = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.backend = sqlalchemy {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.connection = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.connection_debug = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.connection_parameters = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.connection_recycle_time = 3600 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.connection_trace = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.db_inc_retry_interval = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.db_max_retries = 20 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.db_max_retry_interval = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.db_retry_interval = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.max_overflow = 50 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.max_pool_size = 5 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.max_retries = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.mysql_wsrep_sync_wait = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.pool_timeout = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.retry_interval = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.slave_connection = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.sqlite_synchronous = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] database.use_db_reconnect = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.connection_string = messaging:// {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.es_doc_type = notification {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.es_scroll_size = 10000 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.es_scroll_time = 2m {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.filter_error_trace = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.hmac_keys = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74956]: INFO cinder.volume.manager [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.sentinel_service_name = mymaster {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.socket_timeout = 0.1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.trace_requests = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler.trace_sqlalchemy = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler_jaeger.process_tags = {} {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler_jaeger.service_name_prefix = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] profiler_otlp.service_name_prefix = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.enforce_new_defaults = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:13:56 devstack cinder-volume[74822]: WARNING oslo_config.cfg [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.enforce_scope = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.policy_default_rule = default {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.policy_file = policy.yaml {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_policy.remote_timeout = 60.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] privsep_osbrick.group = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] privsep_osbrick.helper_command = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] privsep_osbrick.thread_pool_size = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] privsep_osbrick.user = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_sys_admin.group = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_sys_admin.helper_command = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] cinder_sys_admin.user = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.auth_section = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.auth_type = password {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.certfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.collect_timing = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.insecure = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.keyfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.send_service_user_token = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.split_loggers = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] service_user.timeout = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.backend_availability_zone = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.chap_password = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.chap_username = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.driver_client_cert = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.driver_client_cert_key = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.driver_data_namespace = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.driver_use_ssl = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.enable_unsupported_driver = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.extra_capabilities = {} {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.filter_function = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.goodness_function = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.iscsi_iotype = fileio {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.iscsi_target_flags = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.iscsi_write_cache = on {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.iser_helper = tgtadm {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.iser_ip_address = 192.168.122.66 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.iser_port = 3260 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.lvm_mirrors = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.lvm_share_target = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.lvm_type = auto {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.num_shell_tries = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.nvmet_port_id = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.replication_device = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.report_discard_supported = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.reserved_percentage = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.scst_target_driver = iscsi {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.scst_target_iqn_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.storage_protocol = iSCSI {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.target_helper = tgtadm {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.target_ip_address = 192.168.122.66 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.target_port = 3260 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.target_protocol = iscsi {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.trace_flags = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.unique_fqdn_network = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.use_chap_auth = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_backend_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_clear = zero {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_clear_ionice = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_clear_size = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volume_group = cinder-volumes {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_reports.file_event_handler = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_reports.log_dir = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.backend_availability_zone = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.backend_host = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.chap_password = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.chap_username = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.chiscsi_conf = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.driver_client_cert = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.driver_data_namespace = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.driver_use_ssl = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.extra_capabilities = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.filter_function = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.goodness_function = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.iscsi_iotype = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.iser_helper = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.iser_ip_address = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.iser_port = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.iser_target_prefix = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.lvm_conf_file = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.lvm_mirrors = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.lvm_share_target = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.lvm_type = auto {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.num_shell_tries = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.nvmet_port_id = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.replication_device = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.report_discard_supported = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.reserved_percentage = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.scst_target_driver = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.storage_protocol = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.target_helper = lioadm {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.target_ip_address = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.target_port = 3260 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.target_protocol = iscsi {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.trace_flags = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.use_chap_auth = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_clear = zero {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_clear_size = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] lvmdriver-1.volumes_dir = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.278s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.ssl = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.ssl_version = {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_notifications.driver = [] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_notifications.retry = -1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] oslo_messaging_notifications.transport_url = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] key_manager.fixed_key = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.barbican_api_version = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.barbican_endpoint = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.barbican_endpoint_type = public {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.barbican_region_name = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.cafile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.certfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.collect_timing = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.insecure = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.keyfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.number_of_retries = 60 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.retry_delay = 1 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.send_service_user_token = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.split_loggers = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.timeout = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.verify_ssl = True {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican.verify_ssl_path = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.auth_section = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.auth_type = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.cafile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.certfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.collect_timing = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.insecure = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.keyfile = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.split_loggers = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] barbican_service_user.timeout = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.approle_role_id = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.approle_secret_id = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.kv_mountpoint = secret {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.kv_path = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.kv_version = 2 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.namespace = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.root_token_id = **** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.ssl_ca_crt_file = None {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.timeout = 60.0 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.use_ssl = False {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:13:56 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] ******************************************************************************** {{(pid=74822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 10 17:13:56 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:13:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.100s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:13:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:13:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.093s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:13:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:13:57 devstack sudo[75027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 10 17:13:57 devstack sudo[75027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:13:59 devstack sudo[75027]: pam_unix(sudo:session): session closed for user root Sep 10 17:13:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.148s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:13:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:13:59 devstack sudo[75143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:13:59 devstack sudo[75143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:01 devstack sudo[75143]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.150s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:14:01 devstack cinder-volume[74956]: INFO cinder.brick.local_dev.lvm [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 10 17:14:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:01 devstack sudo[75234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:14:01 devstack sudo[75234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:03 devstack sudo[75234]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:03 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.102s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:03 devstack cinder-volume[74956]: DEBUG cinder.brick.local_dev.lvm [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74956) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 10 17:14:03 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:03 devstack sudo[75330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:14:03 devstack sudo[75330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:05 devstack cinder-volume[74822]: DEBUG dbcounter [-] [74822] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74822) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:14:07 devstack sudo[75330]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:07 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.677s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:07 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:07 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.200s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:07 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:07 devstack sudo[75538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:14:07 devstack sudo[75538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:10 devstack sudo[75538]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:10 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.347s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:10 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:10 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.128s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:10 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:10 devstack sudo[75581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 10 17:14:10 devstack sudo[75581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:13 devstack sudo[75581]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:13 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.996s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:13 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:13 devstack sudo[75633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:14:13 devstack sudo[75633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:16 devstack sudo[75633]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:17 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.698s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:17 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:17 devstack sudo[75673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:14:17 devstack sudo[75673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:20 devstack sudo[75673]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:20 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.236s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:20 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:20 devstack sudo[75678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:14:20 devstack sudo[75678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:23 devstack sudo[75678]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:23 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.895s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:23 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:23 devstack sudo[75683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:14:23 devstack sudo[75683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:25 devstack sudo[75683]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:25 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.258s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:25 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:25 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.128s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:25 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:25 devstack sudo[75692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:14:25 devstack sudo[75692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:28 devstack sudo[75692]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:28 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.427s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:28 devstack cinder-volume[74956]: INFO cinder.volume.drivers.lvm [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 10 17:14:28 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:28 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.077s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:28 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:28 devstack sudo[75807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:14:28 devstack sudo[75807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:30 devstack sudo[75807]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:30 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.119s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:30 devstack cinder-volume[74956]: DEBUG cinder.volume.drivers.lvm [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Updating volume stats {{(pid=74956) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 17:14:30 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:30 devstack sudo[75891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:14:30 devstack sudo[75891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:32 devstack sudo[75891]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:32 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.246s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:32 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:32 devstack sudo[75950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:14:32 devstack sudo[75950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:34 devstack sudo[75950]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:34 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.193s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:34 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:35 devstack sudo[75953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:14:35 devstack sudo[75953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:36 devstack sudo[75953]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:37 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.085s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:37 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:37 devstack sudo[75959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:14:37 devstack sudo[75959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:39 devstack sudo[75959]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:39 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.310s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:39 devstack cinder-volume[74956]: INFO cinder.volume.driver [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Driver hasn't implemented _init_vendor_properties() Sep 10 17:14:39 devstack cinder-volume[74956]: DEBUG cinder.volume.driver [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74956) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 10 17:14:39 devstack cinder-volume[74956]: DEBUG oslo_db.sqlalchemy.engines [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74956) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:14:39 devstack cinder-volume[74956]: DEBUG dbcounter [-] [74956] Writer thread running {{(pid=74956) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 17:14:39 devstack cinder-volume[74956]: DEBUG cinder.db.sqlalchemy.api [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Building query based on filter {{(pid=74956) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 10 17:14:40 devstack cinder-volume[74956]: DEBUG cinder.image.image_utils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74956) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 10 17:14:40 devstack cinder-volume[74956]: INFO cinder.keymgr.migration [None req-9ffc7a06-e234-4418-b0c9-8643d7fdca2b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 17:14:40 devstack cinder-volume[74956]: DEBUG cinder.volume.drivers.lvm [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Updating volume stats {{(pid=74956) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 17:14:40 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:40 devstack sudo[75996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:14:40 devstack sudo[75996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:42 devstack sudo[75996]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:42 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.297s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:42 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:42 devstack sudo[76041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:14:42 devstack sudo[76041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:44 devstack sudo[76041]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:44 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.134s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:44 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:44 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:14:44 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:46 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:46 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.027s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:46 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:46 devstack sudo[76150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:14:46 devstack sudo[76150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:48 devstack sudo[76150]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:48 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.041s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:48 devstack cinder-volume[74956]: DEBUG cinder.manager [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Notifying Schedulers of capabilities ... {{(pid=74956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:14:49 devstack cinder-volume[74956]: INFO cinder.volume.manager [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Driver initialization completed successfully. Sep 10 17:14:49 devstack cinder-volume[74956]: INFO cinder.manager [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Initiating service 2 cleanup Sep 10 17:14:49 devstack cinder-volume[74956]: INFO cinder.manager [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Service 2 cleanup completed. Sep 10 17:14:49 devstack cinder-volume[74956]: DEBUG cinder.service [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Creating RPC server for service cinder-volume {{(pid=74956) start /opt/stack/cinder/cinder/service.py:239}} Sep 10 17:14:49 devstack cinder-volume[74956]: DEBUG cinder.service [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74956) start /opt/stack/cinder/cinder/service.py:245}} Sep 10 17:14:49 devstack cinder-volume[74956]: INFO cinder.volume.manager [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 10 17:14:49 devstack cinder-volume[74956]: DEBUG cinder.volume.drivers.lvm [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Updating volume stats {{(pid=74956) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 17:14:49 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:49 devstack sudo[76153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:14:49 devstack sudo[76153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:51 devstack sudo[76153]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:51 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.853s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:51 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:51 devstack sudo[76161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:14:51 devstack sudo[76161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:53 devstack sudo[76161]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:53 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.066s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:53 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:53 devstack sudo[76164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:14:53 devstack sudo[76164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:55 devstack sudo[76164]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:55 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.025s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:55 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:14:55 devstack sudo[76171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:14:55 devstack sudo[76171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:14:57 devstack sudo[76171]: pam_unix(sudo:session): session closed for user root Sep 10 17:14:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.299s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:14:57 devstack cinder-volume[74956]: DEBUG dbcounter [-] [74956] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74956) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:14:57 devstack cinder-volume[74956]: INFO cinder.volume.manager [None req-a172e5ea-2b1c-4ac2-8537-14894653933e None None] Driver post RPC initialization completed successfully. Sep 10 17:15:07 devstack cinder-volume[74956]: DEBUG dbcounter [-] [74956] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=74956) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:15:54 devstack cinder-volume[74956]: DEBUG oslo_service.periodic_task [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74956) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:15:54 devstack cinder-volume[74956]: DEBUG cinder.volume.drivers.lvm [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Updating volume stats {{(pid=74956) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 17:15:54 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:15:55 devstack sudo[77306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:15:55 devstack sudo[77306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:15:57 devstack sudo[77306]: pam_unix(sudo:session): session closed for user root Sep 10 17:15:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.142s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:15:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:15:57 devstack sudo[77428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:15:57 devstack sudo[77428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:15:59 devstack sudo[77428]: pam_unix(sudo:session): session closed for user root Sep 10 17:15:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.317s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:15:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:15:59 devstack sudo[77524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:15:59 devstack sudo[77524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:16:01 devstack sudo[77524]: pam_unix(sudo:session): session closed for user root Sep 10 17:16:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.026s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:16:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:16:01 devstack sudo[77530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:16:01 devstack sudo[77530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:16:03 devstack sudo[77530]: pam_unix(sudo:session): session closed for user root Sep 10 17:16:03 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.878s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:16:03 devstack cinder-volume[74956]: DEBUG cinder.manager [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Notifying Schedulers of capabilities ... {{(pid=74956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:16:54 devstack cinder-volume[74956]: DEBUG oslo_service.periodic_task [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74956) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:16:54 devstack cinder-volume[74956]: DEBUG cinder.volume.drivers.lvm [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Updating volume stats {{(pid=74956) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 17:16:54 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:16:55 devstack sudo[77935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:16:55 devstack sudo[77935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:16:56 devstack sudo[77935]: pam_unix(sudo:session): session closed for user root Sep 10 17:16:56 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.977s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:16:56 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:16:57 devstack sudo[77965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:16:57 devstack sudo[77965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:16:59 devstack sudo[77965]: pam_unix(sudo:session): session closed for user root Sep 10 17:16:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.271s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:16:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:16:59 devstack sudo[77970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:16:59 devstack sudo[77970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:17:01 devstack sudo[77970]: pam_unix(sudo:session): session closed for user root Sep 10 17:17:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.161s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:17:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:17:01 devstack sudo[77978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:17:01 devstack sudo[77978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:17:03 devstack sudo[77978]: pam_unix(sudo:session): session closed for user root Sep 10 17:17:03 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.171s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:17:03 devstack cinder-volume[74956]: DEBUG cinder.manager [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Notifying Schedulers of capabilities ... {{(pid=74956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:17:08 devstack cinder-volume[74956]: DEBUG dbcounter [-] [74956] Writing DB stats cinder:SELECT=1 {{(pid=74956) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:17:08 devstack cinder-volume[74956]: DEBUG dbcounter [-] [74956] Writing DB stats cinder:UPDATE=1 {{(pid=74956) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:18:54 devstack cinder-volume[74956]: DEBUG oslo_service.periodic_task [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74956) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:18:54 devstack cinder-volume[74956]: DEBUG cinder.volume.drivers.lvm [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Updating volume stats {{(pid=74956) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 17:18:54 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:18:55 devstack sudo[81214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:18:55 devstack sudo[81214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:18:56 devstack sudo[81214]: pam_unix(sudo:session): session closed for user root Sep 10 17:18:56 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.029s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:18:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:18:57 devstack sudo[81221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:18:57 devstack sudo[81221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:18:59 devstack sudo[81221]: pam_unix(sudo:session): session closed for user root Sep 10 17:18:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.160s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:18:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:18:59 devstack sudo[81226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:18:59 devstack sudo[81226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:19:01 devstack sudo[81226]: pam_unix(sudo:session): session closed for user root Sep 10 17:19:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.098s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:19:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:19:01 devstack sudo[81237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:19:01 devstack sudo[81237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:19:03 devstack sudo[81237]: pam_unix(sudo:session): session closed for user root Sep 10 17:19:03 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.004s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:19:03 devstack cinder-volume[74956]: DEBUG cinder.manager [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Notifying Schedulers of capabilities ... {{(pid=74956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:19:08 devstack cinder-volume[74956]: DEBUG dbcounter [-] [74956] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74956) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:19:54 devstack cinder-volume[74956]: DEBUG oslo_service.periodic_task [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74956) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:19:54 devstack cinder-volume[74956]: DEBUG cinder.volume.drivers.lvm [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Updating volume stats {{(pid=74956) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 17:19:54 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:19:55 devstack sudo[81422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 17:19:55 devstack sudo[81422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:19:56 devstack sudo[81422]: pam_unix(sudo:session): session closed for user root Sep 10 17:19:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.054s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:19:57 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:19:57 devstack sudo[81427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:19:57 devstack sudo[81427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:19:59 devstack sudo[81427]: pam_unix(sudo:session): session closed for user root Sep 10 17:19:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.099s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:19:59 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:19:59 devstack sudo[81433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 17:19:59 devstack sudo[81433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:20:01 devstack sudo[81433]: pam_unix(sudo:session): session closed for user root Sep 10 17:20:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.033s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:20:01 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:20:01 devstack sudo[81445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 17:20:01 devstack sudo[81445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:20:03 devstack sudo[81445]: pam_unix(sudo:session): session closed for user root Sep 10 17:20:03 devstack cinder-volume[74956]: DEBUG oslo_concurrency.processutils [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.938s {{(pid=74956) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:20:03 devstack cinder-volume[74956]: DEBUG cinder.manager [None req-c0191f8f-9e97-4090-b420-36db8f7b7caa None None] Notifying Schedulers of capabilities ... {{(pid=74956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:20:49 devstack cinder-volume[74822]: INFO oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Caught SIGTERM, stopping children Sep 10 17:20:49 devstack cinder-volume[74822]: DEBUG oslo_concurrency.lockutils [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Acquiring lock "singleton_lock" {{(pid=74822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 17:20:49 devstack cinder-volume[74822]: DEBUG oslo_concurrency.lockutils [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Acquired lock "singleton_lock" {{(pid=74822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 17:20:49 devstack cinder-volume[74822]: DEBUG oslo_concurrency.lockutils [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Releasing lock "singleton_lock" {{(pid=74822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 17:20:49 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Stop services. {{(pid=74822) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 10 17:20:49 devstack cinder-volume[74822]: DEBUG oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Killing children. {{(pid=74822) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 10 17:20:49 devstack cinder-volume[74822]: INFO oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Waiting on 1 children to exit Sep 10 17:20:54 devstack cinder-volume[74956]: DEBUG oslo_concurrency.lockutils [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Acquiring lock "singleton_lock" {{(pid=74956) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 17:20:54 devstack cinder-volume[74956]: DEBUG oslo_concurrency.lockutils [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Acquired lock "singleton_lock" {{(pid=74956) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 17:20:54 devstack cinder-volume[74956]: DEBUG oslo_concurrency.lockutils [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Releasing lock "singleton_lock" {{(pid=74956) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 17:20:54 devstack cinder-volume[74956]: WARNING amqp [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 17:20:54 devstack cinder-volume[74956]: WARNING amqp [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 17:20:54 devstack cinder-volume[74822]: INFO oslo_service.backend._eventlet.service [None req-b0ecedcd-6408-4f35-a1c2-850de2a8803b None None] Child 74956 exited with status 0 Sep 10 17:21:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 17:21:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 17:21:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 17:21:14 devstack cinder-volume[82391]: INFO dbcounter [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Registered counter for database cinder Sep 10 17:21:14 devstack cinder-volume[82391]: DEBUG oslo_db.sqlalchemy.engines [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:21:14 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writer thread running {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 17:21:14 devstack cinder-volume[82391]: INFO cinder.rpc [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 17:21:14 devstack cinder-volume[82391]: INFO cinder.rpc [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 17:21:14 devstack cinder-volume[82391]: DEBUG oslo_db.sqlalchemy.engines [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:21:14 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Determined volume DB was empty at startup. Sep 10 17:21:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82391) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 10 17:21:14 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 17:21:14 devstack cinder-volume[82391]: WARNING stevedore.named [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 17:21:14 devstack cinder-volume[82391]: WARNING castellan.key_manager [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 17:21:14 devstack cinder-volume[82391]: WARNING cinder.keymgr.conf_key_mgr [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 17:21:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_db.sqlalchemy.engines [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:21:15 devstack cinder-volume[82391]: INFO oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Starting 1 workers Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Started child 82609 {{(pid=82391) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Full set of CONF: {{(pid=82391) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] ******************************************************************************** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Configuration options gathered from: {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] ================================================================================ {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] allow_availability_zone_fallback = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] allow_compression_on_image_upload = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] allowed_direct_url_schemes = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] api_rate_limit = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82609]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] auth_strategy = keystone {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_availability_zone = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_host = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_stats_polling_interval = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backup_api_class = cinder.backup.api.API {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backup_name_template = backup-%s {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backup_use_same_host = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backup_use_temp_snapshot = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] chap_password = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] chap_username = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_internal_tenant_project_id = 373393203b204c2aa9d106bcd69e6ff0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_internal_tenant_user_id = e7a88c1b31e641c19724c9fb1ed33205 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cluster = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] compression_format = gzip {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] compute_api_class = cinder.compute.nova.API {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] config_dir = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] config_source = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] control_exchange = openstack {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] debug = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] default_availability_zone = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] default_group_type = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] default_volume_type = QuobyteHD {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] driver_client_cert = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] driver_client_cert_key = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] driver_data_namespace = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] driver_ssl_cert_path = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] driver_ssl_cert_verify = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] driver_use_ssl = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] enable_new_services = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] enable_unsupported_driver = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] enabled_backends = ['QuobyteHD'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] enforce_multipath_for_image_xfer = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] filter_function = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_api_insecure = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_api_servers = ['http://192.168.122.66/image'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_api_ssl_compression = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_ca_certificates_file = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_catalog_info = image:glance:publicURL {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_certfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_keyfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_num_retries = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] glance_request_timeout = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] goodness_function = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] graceful_shutdown_timeout = 5 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] group_api_class = cinder.group.api.API {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] host = devstack {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_compress_on_upload = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_conversion_address_space_limit = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_conversion_cpu_limit = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_conversion_disable = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_upload_use_cinder_backend = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_upload_use_internal_tenant = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_volume_cache_enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_volume_cache_max_count = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] image_volume_cache_max_size_gb = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] init_host_max_objects_retrieval = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] instance_format = [instance: %(uuid)s] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] iscsi_iotype = fileio {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] iscsi_target_flags = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] iscsi_write_cache = on {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] iser_helper = tgtadm {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] iser_ip_address = 192.168.122.66 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] iser_port = 3260 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_color = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_config_append = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_dir = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_file = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_options = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_rotate_interval = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_rotate_interval_type = days {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] log_rotation_type = none {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] max_age = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] max_logfile_count = 30 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] max_logfile_size_mb = 200 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] max_over_subscription_ratio = 20.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] message_reap_interval = 86400 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] message_ttl = 2592000 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] migration_create_volume_timeout_secs = 300 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] monkey_patch = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] monkey_patch_modules = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] my_ip = 192.168.122.66 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] no_snapshot_gb_quota = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] num_iser_scan_tries = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] num_shell_tries = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] num_volume_device_scan_tries = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] nvmeof_conn_info_version = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] nvmet_ns_id = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] nvmet_port_id = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] osapi_max_limit = 1000 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] osapi_volume_ext_list = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] osapi_volume_listen_port = 8776 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] osapi_volume_use_ssl = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] osapi_volume_workers = 2 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] per_volume_size_limit = -1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] periodic_fuzzy_delay = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] periodic_interval = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] public_endpoint = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] publish_errors = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] quota_backup_gigabytes = 1000 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] quota_backups = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] quota_gigabytes = 1000 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] quota_groups = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] quota_snapshots = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] quota_volumes = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] rate_limit_burst = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] rate_limit_except_level = CRITICAL {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] rate_limit_interval = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] reinit_driver_count = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] replication_device = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] report_discard_supported = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] report_interval = 120 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] reservation_clean_interval = 86400 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] reservation_expire = 86400 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] reserved_image_namespaces = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] reserved_percentage = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] rpc_response_timeout = 120 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] run_external_periodic_tasks = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] scst_target_driver = iscsi {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] scst_target_iqn_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_down_time = 720 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] shell_completion = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] snapshot_name_template = snapshot-%s {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] split_loggers = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] state_path = /opt/stack/data/cinder {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] storage_availability_zone = nova {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] storage_protocol = iSCSI {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] syslog_log_facility = LOG_USER {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] target_helper = lioadm {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] target_ip_address = 192.168.122.66 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] target_port = 3260 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] target_protocol = iscsi {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] target_secondary_ip_addresses = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] trace_flags = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] transport_url = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] until_refresh = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] use_chap_auth = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] use_default_quota_class = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] use_journal = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] use_json = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] use_multipath_for_image_xfer = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] use_stderr = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] use_syslog = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] verify_glance_signatures = enabled {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_api_class = cinder.volume.api.API {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_backend_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_clear = zero {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_clear_ionice = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_clear_size = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_copy_bps_limit = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_dd_blocksize = 1M {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_name_template = volume-%s {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_service_inithost_offload = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volume_usage_audit_period = month {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] watch_log_file = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] zoning_mode = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_concurrency.disable_process_locking = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.admin_password = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.admin_token = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.admin_user = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.auth_port = 35357 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.auth_protocol = https {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.auth_section = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.auth_type = password {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.auth_uri = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.auth_version = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.cache = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.certfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.identity_uri = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.include_service_catalog = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.insecure = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.interface = public {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.keyfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_password = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcache_username = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.region_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.service_type = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.backend = dogpile.cache.null {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.backend_argument = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.backend_expiration_time = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.config_prefix = cache.oslo {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.dead_timeout = 60.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.debug_cache_backend = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.enable_retry_client = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.enable_socket_keepalive = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.enforce_fips_mode = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.expiration_time = 600 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.hashclient_retry_attempts = 2 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_dead_retry = 300 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_password = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_pool_maxsize = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_sasl_enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.memcache_username = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.proxies = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.redis_db = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.redis_password = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.redis_server = localhost:6379 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.redis_socket_timeout = 1.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.redis_username = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.retry_attempts = 2 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.retry_delay = 0.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.socket_keepalive_count = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.socket_keepalive_idle = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.socket_keepalive_interval = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.tls_allowed_ciphers = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.tls_cafile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.tls_certfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.tls_enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cache.tls_keyfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] coordination.backend_url = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.asyncio_connection = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.asyncio_slave_connection = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.backend = sqlalchemy {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.connection = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.connection_debug = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.connection_parameters = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.connection_recycle_time = 3600 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.connection_trace = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.db_inc_retry_interval = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.db_max_retries = 20 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.db_max_retry_interval = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.db_retry_interval = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.max_overflow = 50 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.max_pool_size = 5 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.max_retries = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.mysql_wsrep_sync_wait = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.pool_timeout = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.retry_interval = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.slave_connection = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.sqlite_synchronous = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] database.use_db_reconnect = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.connection_string = messaging:// {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.es_doc_type = notification {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.es_scroll_size = 10000 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.es_scroll_time = 2m {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.filter_error_trace = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.hmac_keys = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.sentinel_service_name = mymaster {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.socket_timeout = 0.1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.trace_requests = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler.trace_sqlalchemy = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler_jaeger.process_tags = {} {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler_jaeger.service_name_prefix = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] profiler_otlp.service_name_prefix = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.enforce_new_defaults = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Starting volume driver QuobyteDriver (1.1.13) Sep 10 17:21:15 devstack cinder-volume[82391]: WARNING oslo_config.cfg [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.enforce_scope = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.policy_default_rule = default {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.policy_file = policy.yaml {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82609) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] privsep_osbrick.group = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] privsep_osbrick.helper_command = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] privsep_osbrick.user = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_sys_admin.group = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_sys_admin.helper_command = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] cinder_sys_admin.user = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.auth_section = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.auth_type = password {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.certfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.collect_timing = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.insecure = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.keyfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.send_service_user_token = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.split_loggers = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] service_user.timeout = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.backend_availability_zone = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.chap_password = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.chap_username = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.driver_client_cert = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.driver_client_cert_key = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.driver_data_namespace = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.driver_use_ssl = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.extra_capabilities = {} {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.filter_function = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.goodness_function = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.iscsi_iotype = fileio {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.iscsi_target_flags = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.iscsi_write_cache = on {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.iser_helper = tgtadm {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.iser_ip_address = 192.168.122.66 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.iser_port = 3260 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_host = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_login = admin {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_mount_options = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_password = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_private_key = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_share_path = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.num_shell_tries = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.quobyte_volume_url = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.replication_device = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.report_discard_supported = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.reserved_percentage = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.target_helper = tgtadm {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.target_ip_address = 192.168.122.66 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.target_port = 3260 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.target_protocol = iscsi {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.trace_flags = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.unique_fqdn_network = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.use_chap_auth = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:15 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volume_backend_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volume_clear = zero {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volume_clear_ionice = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volume_clear_size = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_reports.file_event_handler = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_reports.log_dir = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.backend_availability_zone = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.backend_host = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.chap_password = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.chap_username = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.chiscsi_conf = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.driver_client_cert = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.driver_data_namespace = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.driver_use_ssl = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.extra_capabilities = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.filter_function = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.goodness_function = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.iscsi_iotype = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.iser_helper = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.iser_ip_address = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.iser_port = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.iser_target_prefix = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_host = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_login = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_mount_options = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_password = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_private_key = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_share_path = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_ssh_port = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.num_shell_tries = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.nvmet_port_id = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.replication_device = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.report_discard_supported = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.reserved_percentage = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.scst_target_driver = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.storage_protocol = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.target_helper = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.target_ip_address = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.target_port = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.target_prefix = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.target_protocol = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.trace_flags = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.use_chap_auth = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volume_clear = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volume_clear_size = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] QuobyteHD.volumes_dir = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.ssl = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_notifications.driver = [] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_notifications.retry = -1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] key_manager.fixed_key = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.barbican_api_version = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.barbican_endpoint = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.barbican_endpoint_type = public {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.barbican_region_name = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.cafile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.certfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.collect_timing = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.insecure = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.keyfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.number_of_retries = 60 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.retry_delay = 1 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.send_service_user_token = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.split_loggers = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.timeout = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.verify_ssl = True {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican.verify_ssl_path = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.auth_section = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.auth_type = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.cafile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.certfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.collect_timing = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.insecure = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.keyfile = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.split_loggers = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] barbican_service_user.timeout = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.approle_role_id = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.approle_secret_id = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.kv_mountpoint = secret {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.kv_path = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.kv_version = 2 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.namespace = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.root_token_id = **** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.ssl_ca_crt_file = None {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.timeout = 60.0 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.use_ssl = False {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 17:21:16 devstack cinder-volume[82391]: DEBUG oslo_service.backend._eventlet.service [None req-eb098838-c763-49e2-9087-100c3af3b247 None None] ******************************************************************************** {{(pid=82391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 10 17:21:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82609) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 10 17:21:16 devstack cinder-volume[82609]: INFO cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 10 17:21:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Running cmd (subprocess): mount.quobyte {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:21:16 devstack quobyte-client[82623]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 17:21:16 devstack quobyte-client[82623]: Invalid parameters found, error: missing mount point. Sep 10 17:21:16 devstack quobyte-client[82623]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 17:21:16 devstack quobyte-client[82623]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 10 17:21:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] CMD "mount.quobyte" returned: 1 in 0.488s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:21:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:21:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:21:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:21:16 devstack cinder-volume[82609]: INFO cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Mounting volume: 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 ... Sep 10 17:21:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 -c /etc/quobyte/client-cinder.cfg {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:21:17 devstack quobyte-client[82624]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 10 17:21:17 devstack quobyte-client[82624]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 17:21:17 devstack quobyte-client[82624]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0' to display the log. Sep 10 17:21:17 devstack quobyte-client[82625]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 10 17:21:17 devstack quobyte-client[82625]: mount.quobyte 3.25 (4fbbd59204) Sep 10 17:21:17 devstack quobyte-client[82625]: Client UUID: 4oazY5KM-vTYR-HORL-XOcM-849Xp2FYCvu2 Sep 10 17:21:17 devstack quobyte-client[82625]: Registry: osci01.corp.quobyte.com:7861 Sep 10 17:21:17 devstack quobyte-client[82625]: Volume: cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:21:17 devstack quobyte-client[82625]: FUSE version: 316 Sep 10 17:21:17 devstack quobyte-client[82625]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 10 17:21:17 devstack quobyte-client[82625]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 10 17:21:17 devstack quobyte-client[82625]: Setting total object cache size to 3352297472 bytes Sep 10 17:21:17 devstack quobyte-client[82625]: Using FUSE low-level API Sep 10 17:21:17 devstack quobyte-client[82625]: Caching of uid/gid to user/group name mappings is enabled Sep 10 17:21:17 devstack quobyte-client[82625]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 10 17:21:17 devstack quobyte-client[82625]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 10 17:21:17 devstack quobyte-client[82625]: HTTP server started on port 55000 Sep 10 17:21:17 devstack quobyte-client[82625]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 10 17:21:17 devstack quobyte-client[82625]: Mount point /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 established Sep 10 17:21:17 devstack quobyte-client[82625]: TimeSync is running and remote sync every 60 seconds Sep 10 17:21:17 devstack quobyte-client[82625]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 17:21:17 devstack quobyte-client[82625]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 17:21:17 devstack quobyte-client[82625]: Opening volume cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 (da322b66-fd1f-4ab1-a4b0-9f584ec683ba) Sep 10 17:21:17 devstack quobyte-client[82625]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 10 17:21:17 devstack quobyte-client[82625]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 17:21:17 devstack quobyte-client[82625]: Failed to invalidate inode: 38: Function not implemented Sep 10 17:21:17 devstack quobyte-client[82625]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 17:21:17 devstack quobyte-client[82625]: Automatic minidump upload enabled by global system configuration Sep 10 17:21:17 devstack quobyte-client[82625]: Announcing HTTP status server address 172.24.4.1 Sep 10 17:21:17 devstack quobyte-client[82625]: Registered as service (uuid 4oazY5KM-vTYR-HORL-XOcM-849Xp2FYCvu2) Sep 10 17:21:17 devstack quobyte-client[82625]: Quobyte Client running as pid 82625 Sep 10 17:21:17 devstack quobyte-client[82625]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 10 17:21:17 devstack quobyte-client[82625]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 10 17:21:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.698s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:21:17 devstack cinder-volume[82609]: INFO cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Mounting volume: 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 succeeded Sep 10 17:21:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:21:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.758s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:21:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:21:17 devstack quobyte-client[82625]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 17:21:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.122s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:21:17 devstack cinder-volume[82609]: INFO cinder.volume.driver [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 17:21:17 devstack cinder-volume[82609]: DEBUG cinder.volume.driver [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.8647689819336, 'free_capacity_gb': 924.8647689819336, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82609) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 10 17:21:17 devstack cinder-volume[82609]: DEBUG oslo_db.sqlalchemy.engines [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82609) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writer thread running {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG cinder.db.sqlalchemy.api [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Building query based on filter {{(pid=82609) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82609) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 10 17:21:18 devstack cinder-volume[82609]: INFO cinder.keymgr.migration [None req-5a964758-e3aa-4a6c-acac-819ce6823e14 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.126s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:21:18 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Driver initialization completed successfully. Sep 10 17:21:18 devstack cinder-volume[82609]: INFO cinder.manager [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Initiating service 3 cleanup Sep 10 17:21:18 devstack cinder-volume[82609]: INFO cinder.manager [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Service 3 cleanup completed. Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG cinder.service [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Creating RPC server for service cinder-volume {{(pid=82609) start /opt/stack/cinder/cinder/service.py:239}} Sep 10 17:21:18 devstack cinder-volume[82609]: DEBUG cinder.service [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82609) start /opt/stack/cinder/cinder/service.py:245}} Sep 10 17:21:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 10 17:21:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:21:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:21:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:21:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:21:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:21:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:21:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:21:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:21:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.119s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:21:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c501bc3b-4a1c-400a-8121-e5b1f6799de4 None None] Driver post RPC initialization completed successfully. Sep 10 17:21:20 devstack quobyte-client[82625]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 17:21:25 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:21:29 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:21:29 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.183s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:22:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:22:39 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:22:39 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:22:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Flow 'volume_create_manager' (92586c67-6975-4661-ae53-d2f5dc5fd311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:22:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cd76b6-8c97-4733-80b7-ad0e5b535257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cd76b6-8c97-4733-80b7-ad0e5b535257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1393847706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf335b2-89b2-4c9c-bb23-830e5813d748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0036249de9ce4266a9dfe3d91b0914fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:22:39Z,use_quota=True,user_id='5e2d83a8d4604cd886693664a2e562a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225cb787-e8f6-491a-90d2-a4cf4dbad07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225cb787-e8f6-491a-90d2-a4cf4dbad07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62aff2ef-f6b6-422a-b2a3-8268dc624661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62aff2ef-f6b6-422a-b2a3-8268dc624661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf335b2-89b2-4c9c-bb23-830e5813d748', 'volume_name': 'volume-6cf335b2-89b2-4c9c-bb23-830e5813d748', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a9bfb3-4b93-49fd-8b0b-c1ed9549b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a9bfb3-4b93-49fd-8b0b-c1ed9549b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd0556f-8e00-42e2-ba9d-0fecfa462d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:22:40 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Volume 6cf335b2-89b2-4c9c-bb23-830e5813d748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf335b2-89b2-4c9c-bb23-830e5813d748', 'volume_size': 1} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1393847706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf335b2-89b2-4c9c-bb23-830e5813d748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0036249de9ce4266a9dfe3d91b0914fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:22:39Z,use_quota=True,user_id='5e2d83a8d4604cd886693664a2e562a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Creating volume 6cf335b2-89b2-4c9c-bb23-830e5813d748 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:22:40 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:22:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:22:40 devstack quobyte-client[82625]: System call of process 82924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:22:41 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=2, name=volume-6cf335b2-89b2-4c9c-bb23-830e5813d748, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:22:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748 1073741824" returned: 0 in 1.332s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:22:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:22:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748" returned: 0 in 0.184s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:22:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] <== create_volume: return (1671ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:22:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:22:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd0556f-8e00-42e2-ba9d-0fecfa462d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf335b2-89b2-4c9c-bb23-830e5813d748', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:22:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80176874-98f3-4a7c-a0da-bb4d43dad889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:22:42 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Volume volume-6cf335b2-89b2-4c9c-bb23-830e5813d748 (6cf335b2-89b2-4c9c-bb23-830e5813d748): created successfully Sep 10 17:22:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80176874-98f3-4a7c-a0da-bb4d43dad889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:22:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Flow 'volume_create_manager' (92586c67-6975-4661-ae53-d2f5dc5fd311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:22:43 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-fe935f40-c05c-470f-bf81-4e8938f56786 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Created volume successfully. Sep 10 17:22:52 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:22:53 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:23:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:23:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:23:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:23:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:23:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:23:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:23:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:23:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.433s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:23:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:23:29 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:23:30 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.119s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:24:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:24:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Flow 'volume_create_manager' (e5c52635-52cb-4519-89cd-9dd7e5730f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d372aa98-4a39-4cf8-8b47-e8d21e354c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d372aa98-4a39-4cf8-8b47-e8d21e354c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2123892814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9c8ef6-e247-44d9-ae69-876b596f8faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a88cf217dc1407eaff5b23e25f7ed8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:56Z,use_quota=True,user_id='b9eeeeed4fe8428394240017d401520d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d381bec3-65f7-4b1b-8c96-b8049a5986e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d381bec3-65f7-4b1b-8c96-b8049a5986e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cca243-6d31-4d62-8763-cc1d91c5dc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cca243-6d31-4d62-8763-cc1d91c5dc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9c8ef6-e247-44d9-ae69-876b596f8faa', 'volume_name': 'volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1572febb-dfc2-4e46-b7cb-3e93a5fd5b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1572febb-dfc2-4e46-b7cb-3e93a5fd5b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc90b1b-aa6e-41c7-a911-41c8eb22742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Volume 9d9c8ef6-e247-44d9-ae69-876b596f8faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa', 'volume_size': 1} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2123892814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9c8ef6-e247-44d9-ae69-876b596f8faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a88cf217dc1407eaff5b23e25f7ed8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:56Z,use_quota=True,user_id='b9eeeeed4fe8428394240017d401520d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Creating volume 9d9c8ef6-e247-44d9-ae69-876b596f8faa {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:24:57 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:24:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:24:57 devstack quobyte-client[82625]: System call of process 84004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:24:57 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=3, name=volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:24:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:24:58 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:24:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Flow 'volume_create_manager' (bd5fb30c-11ef-4a71-976b-0a66bc1549a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:24:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb583983-c3c0-47f8-ab5a-b987e8a4fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa 1073741824" returned: 0 in 0.977s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:24:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb583983-c3c0-47f8-ab5a-b987e8a4fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1565132296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a661fc2-b3d8-402a-8d3e-c785258f76c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292b60ab84fd4d72930bfc86a78eea8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:57Z,use_quota=True,user_id='30a96890bfe24c3d97033bafa903a710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64be9bb8-ee56-41b5-a384-19d38f6e2edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64be9bb8-ee56-41b5-a384-19d38f6e2edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8758680e-e44a-4f87-b58f-ab9a1eb5f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8758680e-e44a-4f87-b58f-ab9a1eb5f702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a661fc2-b3d8-402a-8d3e-c785258f76c7', 'volume_name': 'volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc380957-b2d4-463c-9608-619fe8b58ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc380957-b2d4-463c-9608-619fe8b58ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42e1480-4ba8-4ea6-b784-ef2dda96ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:24:59 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume 2a661fc2-b3d8-402a-8d3e-c785258f76c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7', 'volume_size': 1} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa" returned: 0 in 0.500s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] <== create_volume: return (1501ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1565132296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a661fc2-b3d8-402a-8d3e-c785258f76c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292b60ab84fd4d72930bfc86a78eea8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:57Z,use_quota=True,user_id='30a96890bfe24c3d97033bafa903a710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Creating volume 2a661fc2-b3d8-402a-8d3e-c785258f76c7 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:24:59 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:24:59 devstack quobyte-client[82625]: System call of process 84009 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:24:59 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=4, name=volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc90b1b-aa6e-41c7-a911-41c8eb22742c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:24:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e61d137-be66-4ff2-aa5e-f1562f19e2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7 1073741824" returned: 0 in 0.821s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:25:00 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Volume volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa (9d9c8ef6-e247-44d9-ae69-876b596f8faa): created successfully Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e61d137-be66-4ff2-aa5e-f1562f19e2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Flow 'volume_create_manager' (e5c52635-52cb-4519-89cd-9dd7e5730f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7" returned: 0 in 0.660s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] <== create_volume: return (1524ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:25:00 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-48894df0-84df-481e-8d54-7f3905b9272b tempest-AttachSCSIVolumeTestJSON-913616823 None] Created volume successfully. Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42e1480-4ba8-4ea6-b784-ef2dda96ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:25:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322dc719-8094-44bd-8ce7-7c9fabcfd765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:25:01 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7 (2a661fc2-b3d8-402a-8d3e-c785258f76c7): created successfully Sep 10 17:25:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322dc719-8094-44bd-8ce7-7c9fabcfd765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:25:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Flow 'volume_create_manager' (bd5fb30c-11ef-4a71-976b-0a66bc1549a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:25:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9441eee1-a741-424b-9a8c-d995576a90b2 tempest-AttachVolumeShelveTestJSON-1773656341 None] Created volume successfully. Sep 10 17:25:11 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:25:11 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:25:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:25:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:25:14 devstack cinder-volume[82609]: INFO oslo.privsep.daemon [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptchl0g43/privsep.sock'] Sep 10 17:25:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-06e9c245-4479-4215-8c1a-310e64625a1c req-0edea23a-ef33-475b-8a46-153a2d33fce8 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:25:14 devstack sudo[84317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptchl0g43/privsep.sock Sep 10 17:25:14 devstack sudo[84317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:25:19 devstack sudo[84317]: pam_unix(sudo:session): session closed for user root Sep 10 17:25:19 devstack cinder-volume[82609]: INFO oslo.privsep.daemon [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Spawned new privsep daemon via rootwrap Sep 10 17:25:19 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Accepted privsep connection to /tmp/tmptchl0g43/privsep.sock {{(pid=82609) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 10 17:25:19 devstack cinder-volume[82609]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 10 17:25:19 devstack cinder-volume[82609]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 10 17:25:19 devstack cinder-volume[82609]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 10 17:25:19 devstack cinder-volume[82609]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84325 Sep 10 17:25:19 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b36d03-4b80-4c01-8868-c9e6baac3b8d]: (2,) {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:25:19 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2837926-fca2-44a5-8125-19630ad1258b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:25:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:25:20 devstack quobyte-client[82625]: System call of process 84328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:25:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa" returned: 0 in 0.651s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:25:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 6.196s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:25:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-06e9c245-4479-4215-8c1a-310e64625a1c req-0edea23a-ef33-475b-8a46-153a2d33fce8 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.306s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:25:20 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c837198f-7845-4fb2-99af-26b893fddd37]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:25:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-06e9c245-4479-4215-8c1a-310e64625a1c req-0edea23a-ef33-475b-8a46-153a2d33fce8 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:25:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9009624-dfe0-474c-a16c-67f475d41ae0', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:25:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:25:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-06e9c245-4479-4215-8c1a-310e64625a1c req-0edea23a-ef33-475b-8a46-153a2d33fce8 tempest-VolumesAssistedSnapshotsTest-1911864439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748" returned: 0 in 0.680s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:25:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-06e9c245-4479-4215-8c1a-310e64625a1c req-0edea23a-ef33-475b-8a46-153a2d33fce8 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.777s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:25:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-6bae2fa5-cf1a-4389-bb02-619618a6a537 req-85255c1e-17ee-403b-8d1c-41bb1f0983da tempest-AttachSCSIVolumeTestJSON-913616823 None] attachment_update completed successfully. Sep 10 17:25:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-06e9c245-4479-4215-8c1a-310e64625a1c req-0edea23a-ef33-475b-8a46-153a2d33fce8 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-6cf335b2-89b2-4c9c-bb23-830e5813d748', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6bd652d-f86a-4b6a-909f-1902b16f6fda', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:25:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-06e9c245-4479-4215-8c1a-310e64625a1c req-0edea23a-ef33-475b-8a46-153a2d33fce8 tempest-VolumesAssistedSnapshotsTest-1911864439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:25:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-06e9c245-4479-4215-8c1a-310e64625a1c req-0edea23a-ef33-475b-8a46-153a2d33fce8 tempest-VolumesAssistedSnapshotsTest-1911864439 None] attachment_update completed successfully. Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.228s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:25:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:25:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:25:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=12,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:25:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6a903c2e-6fbe-4b5c-bb72-c468c099e4b7 req-1f5eb0dc-1452-4c56-b987-e142b58117e7 tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:25:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6a903c2e-6fbe-4b5c-bb72-c468c099e4b7 req-1f5eb0dc-1452-4c56-b987-e142b58117e7 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:25:36 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e20961-d110-4fff-a11f-79544213a9e6]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:25:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6a903c2e-6fbe-4b5c-bb72-c468c099e4b7 req-1f5eb0dc-1452-4c56-b987-e142b58117e7 tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:25:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6a903c2e-6fbe-4b5c-bb72-c468c099e4b7 req-1f5eb0dc-1452-4c56-b987-e142b58117e7 tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7" returned: 0 in 0.446s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:25:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6a903c2e-6fbe-4b5c-bb72-c468c099e4b7 req-1f5eb0dc-1452-4c56-b987-e142b58117e7 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.499s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:25:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-6a903c2e-6fbe-4b5c-bb72-c468c099e4b7 req-1f5eb0dc-1452-4c56-b987-e142b58117e7 tempest-AttachVolumeShelveTestJSON-1773656341 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bfe0a24-abaa-47e3-bfc2-3b388c23b869', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:25:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-6a903c2e-6fbe-4b5c-bb72-c468c099e4b7 req-1f5eb0dc-1452-4c56-b987-e142b58117e7 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:25:36 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-6a903c2e-6fbe-4b5c-bb72-c468c099e4b7 req-1f5eb0dc-1452-4c56-b987-e142b58117e7 tempest-AttachVolumeShelveTestJSON-1773656341 None] attachment_update completed successfully. Sep 10 17:25:46 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:25:46 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:25:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-7804f6ad-afc1-4d47-b4e8-43733fe3d960 req-5e294136-9192-414d-9d7a-1696c31e2dbd tempest-VolumesAssistedSnapshotsTest-1911864439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:25:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-7804f6ad-afc1-4d47-b4e8-43733fe3d960 req-5e294136-9192-414d-9d7a-1696c31e2dbd tempest-VolumesAssistedSnapshotsTest-1911864439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:25:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-7804f6ad-afc1-4d47-b4e8-43733fe3d960 req-5e294136-9192-414d-9d7a-1696c31e2dbd tempest-VolumesAssistedSnapshotsTest-1911864439 None] Terminate volume connection completed successfully. Sep 10 17:25:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-7804f6ad-afc1-4d47-b4e8-43733fe3d960 req-5e294136-9192-414d-9d7a-1696c31e2dbd tempest-VolumesAssistedSnapshotsTest-1911864439 None] Deleting attachment a6bd652d-f86a-4b6a-909f-1902b16f6fda. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:25:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-a2bc7c6a-75af-4836-ad4c-e9c8c9e98d19 req-771453ef-c144-44c4-a962-122c1780dc87 tempest-AttachSCSIVolumeTestJSON-913616823 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:25:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-a2bc7c6a-75af-4836-ad4c-e9c8c9e98d19 req-771453ef-c144-44c4-a962-122c1780dc87 tempest-AttachSCSIVolumeTestJSON-913616823 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:25:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-a2bc7c6a-75af-4836-ad4c-e9c8c9e98d19 req-771453ef-c144-44c4-a962-122c1780dc87 tempest-AttachSCSIVolumeTestJSON-913616823 None] Terminate volume connection completed successfully. Sep 10 17:25:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-a2bc7c6a-75af-4836-ad4c-e9c8c9e98d19 req-771453ef-c144-44c4-a962-122c1780dc87 tempest-AttachSCSIVolumeTestJSON-913616823 None] Deleting attachment e9009624-dfe0-474c-a16c-67f475d41ae0. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:25:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Acquiring lock "cinder-6cf335b2-89b2-4c9c-bb23-830e5813d748-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:25:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "cinder-6cf335b2-89b2-4c9c-bb23-830e5813d748-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:25:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:25:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Acquiring lock "cinder-quobyte-6cf335b2-89b2-4c9c-bb23-830e5813d748" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:25:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "cinder-quobyte-6cf335b2-89b2-4c9c-bb23-830e5813d748" acquired by "delete_volume" :: waited 0.028s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:25:56 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b74d49c-8a78-4572-8b93-395868204257]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:25:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:25:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748" returned: 0 in 0.933s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:25:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:25:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6cf335b2-89b2-4c9c-bb23-830e5813d748" returned: 0 in 0.315s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:25:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "cinder-quobyte-6cf335b2-89b2-4c9c-bb23-830e5813d748" released by "delete_volume" :: held 1.489s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:25:58 devstack cinder-volume[82609]: WARNING cinder.quota [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:25:58 devstack cinder-volume[82609]: WARNING cinder.quota [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:25:58 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Created reservations ['4da68194-7c8a-4587-b47d-be506584816d', '4dbab6a8-e1f5-410e-8a1f-b204c74f1e3f', '710e8b47-ee5c-4fcb-88a8-8ab3eeccea37', 'e96e4f21-17de-4fee-959d-8cafaff62e64'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:25:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:25:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:25:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:25:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:25:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:25:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:26:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.429s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:26:00 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:26:00 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Deleted volume successfully. Sep 10 17:26:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9c53441b-1a42-4a57-a214-ca27db773baa tempest-VolumesAssistedSnapshotsTest-1911864439 None] Lock "cinder-6cf335b2-89b2-4c9c-bb23-830e5813d748-delete_volume" released by "delete_volume" :: held 4.200s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:26:09 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:26:10 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:26:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Acquiring lock "cinder-9d9c8ef6-e247-44d9-ae69-876b596f8faa-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:26:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "cinder-9d9c8ef6-e247-44d9-ae69-876b596f8faa-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:26:14 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:26:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Acquiring lock "cinder-quobyte-9d9c8ef6-e247-44d9-ae69-876b596f8faa" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:26:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "cinder-quobyte-9d9c8ef6-e247-44d9-ae69-876b596f8faa" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:26:14 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[066938fc-3dab-4247-af61-99b9d3dd8d3c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:26:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:26:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa" returned: 0 in 0.656s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:26:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:26:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9d9c8ef6-e247-44d9-ae69-876b596f8faa" returned: 0 in 0.112s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:26:15 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "cinder-quobyte-9d9c8ef6-e247-44d9-ae69-876b596f8faa" released by "delete_volume" :: held 1.051s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Created reservations ['8dcca833-cc70-4877-896e-93098bdc5af8', '9e4b8423-83b2-402c-a6f6-5657bd426851', 'dc55a10e-61e5-4feb-871a-70a17d171312', '57baae80-097b-4ee5-81dc-09adbd992775'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.202s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:26:16 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:26:16 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Deleted volume successfully. Sep 10 17:26:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-30420733-96fe-4a70-a5ba-c86487cf76f0 tempest-AttachSCSIVolumeTestJSON-913616823 None] Lock "cinder-9d9c8ef6-e247-44d9-ae69-876b596f8faa-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.125s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:26:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:26:27 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.279s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:27:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:27:29 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:27:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Flow 'volume_create_manager' (3108df9d-667b-46e4-b18c-1a38e7a97349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773d795c-f6c2-4fa4-9218-ec6ee51ba3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773d795c-f6c2-4fa4-9218-ec6ee51ba3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-743401616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a332eec4-32b2-47bf-aef5-a4e0e2c209e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20708cbd72341d982199487f52342df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:56Z,use_quota=True,user_id='d2684a67a1f3486c9bb96828225f3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14167154-ed8c-4579-8871-848d82b861d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14167154-ed8c-4579-8871-848d82b861d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83c0423-2ae7-4834-a06d-89d8136f4e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83c0423-2ae7-4834-a06d-89d8136f4e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a332eec4-32b2-47bf-aef5-a4e0e2c209e7', 'volume_name': 'volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004a7ae1-cbd6-4291-b07b-95ef2a6ae147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:27:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004a7ae1-cbd6-4291-b07b-95ef2a6ae147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998b56c3-f633-4f1e-b1df-a655e3439573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:27:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Volume a332eec4-32b2-47bf-aef5-a4e0e2c209e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7', 'volume_size': 1} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-743401616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a332eec4-32b2-47bf-aef5-a4e0e2c209e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20708cbd72341d982199487f52342df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:56Z,use_quota=True,user_id='d2684a67a1f3486c9bb96828225f3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Creating volume a332eec4-32b2-47bf-aef5-a4e0e2c209e7 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:27:57 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:27:57 devstack quobyte-client[82625]: System call of process 85712 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:27:57 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=5, name=volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7 1073741824" returned: 0 in 0.787s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:27:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:27:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7" returned: 0 in 0.279s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:27:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] <== create_volume: return (1351ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:27:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:27:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998b56c3-f633-4f1e-b1df-a655e3439573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:27:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639fb160-baa2-4e37-bc73-baf21e09348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:27:59 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-dbbc2d18-e362-4a4c-a332-c7f6513928d3 req-d5e1a23f-2694-409e-8764-f7582678fd07 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:27:59 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Volume volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7 (a332eec4-32b2-47bf-aef5-a4e0e2c209e7): created successfully Sep 10 17:27:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639fb160-baa2-4e37-bc73-baf21e09348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:27:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Flow 'volume_create_manager' (3108df9d-667b-46e4-b18c-1a38e7a97349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:27:59 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-dbbc2d18-e362-4a4c-a332-c7f6513928d3 req-d5e1a23f-2694-409e-8764-f7582678fd07 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:27:59 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-dbbc2d18-e362-4a4c-a332-c7f6513928d3 req-d5e1a23f-2694-409e-8764-f7582678fd07 tempest-AttachVolumeShelveTestJSON-1773656341 None] Terminate volume connection completed successfully. Sep 10 17:27:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-dbbc2d18-e362-4a4c-a332-c7f6513928d3 req-d5e1a23f-2694-409e-8764-f7582678fd07 tempest-AttachVolumeShelveTestJSON-1773656341 None] Deleting attachment 6bfe0a24-abaa-47e3-bfc2-3b388c23b869. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:27:59 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f355b333-f21b-47e7-9bd1-53c983d22838 tempest-DeleteServersTestJSON-871789225 None] Created volume successfully. Sep 10 17:28:09 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:28:09 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:28:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-d889b214-2ab8-4d11-991b-5ba5cc500d4c req-94e13a39-0b5b-4c4a-a73a-a386600103a1 tempest-DeleteServersTestJSON-871789225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:28:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-d889b214-2ab8-4d11-991b-5ba5cc500d4c req-94e13a39-0b5b-4c4a-a73a-a386600103a1 tempest-DeleteServersTestJSON-871789225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:28:10 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee965c6-af67-493c-872c-6b8004bd03b0]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:28:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-d889b214-2ab8-4d11-991b-5ba5cc500d4c req-94e13a39-0b5b-4c4a-a73a-a386600103a1 tempest-DeleteServersTestJSON-871789225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-d889b214-2ab8-4d11-991b-5ba5cc500d4c req-94e13a39-0b5b-4c4a-a73a-a386600103a1 tempest-DeleteServersTestJSON-871789225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7" returned: 0 in 1.203s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-d889b214-2ab8-4d11-991b-5ba5cc500d4c req-94e13a39-0b5b-4c4a-a73a-a386600103a1 tempest-DeleteServersTestJSON-871789225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.288s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:28:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-d889b214-2ab8-4d11-991b-5ba5cc500d4c req-94e13a39-0b5b-4c4a-a73a-a386600103a1 tempest-DeleteServersTestJSON-871789225 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b4277e1-36cc-4555-88d5-62e53e6317c2', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:28:12 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-d889b214-2ab8-4d11-991b-5ba5cc500d4c req-94e13a39-0b5b-4c4a-a73a-a386600103a1 tempest-DeleteServersTestJSON-871789225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:28:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-d889b214-2ab8-4d11-991b-5ba5cc500d4c req-94e13a39-0b5b-4c4a-a73a-a386600103a1 tempest-DeleteServersTestJSON-871789225 None] attachment_update completed successfully. Sep 10 17:28:22 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:28:22 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=5 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:28:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:28:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:28:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:28:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:28:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:28:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:28:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.570s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:28:32 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Flow 'volume_create_manager' (9126cfa8-a369-435a-a744-c963a1c55171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6636798a-7ac2-4bb2-9728-cedf9a176d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6636798a-7ac2-4bb2-9728-cedf9a176d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1260699152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11e78d6-f08e-402e-b36a-fa4936d70199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b16788eadd54353817ccf0161cadaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:32Z,use_quota=True,user_id='a5980f52aa41494da0d47e8011623a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952fb7c2-4f5a-45ae-991c-5c2a4b7fa237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952fb7c2-4f5a-45ae-991c-5c2a4b7fa237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac1af4d-fe6f-4e38-887b-a133a4363c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac1af4d-fe6f-4e38-887b-a133a4363c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11e78d6-f08e-402e-b36a-fa4936d70199', 'volume_name': 'volume-c11e78d6-f08e-402e-b36a-fa4936d70199', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712fd5e7-1799-4a3b-b4d0-2772ee947ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712fd5e7-1799-4a3b-b4d0-2772ee947ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e71ce20-89a9-46fd-8bc3-dc3851f702db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:28:32 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Volume c11e78d6-f08e-402e-b36a-fa4936d70199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11e78d6-f08e-402e-b36a-fa4936d70199', 'volume_size': 1} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1260699152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11e78d6-f08e-402e-b36a-fa4936d70199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b16788eadd54353817ccf0161cadaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:32Z,use_quota=True,user_id='a5980f52aa41494da0d47e8011623a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Creating volume c11e78d6-f08e-402e-b36a-fa4936d70199 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:28:32 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:28:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c11e78d6-f08e-402e-b36a-fa4936d70199 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:33 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=6, name=volume-c11e78d6-f08e-402e-b36a-fa4936d70199, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c11e78d6-f08e-402e-b36a-fa4936d70199 1073741824" returned: 0 in 0.551s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c11e78d6-f08e-402e-b36a-fa4936d70199 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c11e78d6-f08e-402e-b36a-fa4936d70199" returned: 0 in 0.137s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] <== create_volume: return (756ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e71ce20-89a9-46fd-8bc3-dc3851f702db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11e78d6-f08e-402e-b36a-fa4936d70199', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb13d5c-b2d9-4dbd-8c04-65aa02d63a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:28:33 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Volume volume-c11e78d6-f08e-402e-b36a-fa4936d70199 (c11e78d6-f08e-402e-b36a-fa4936d70199): created successfully Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb13d5c-b2d9-4dbd-8c04-65aa02d63a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:28:33 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Flow 'volume_create_manager' (9126cfa8-a369-435a-a744-c963a1c55171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:28:33 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ec7f89b5-8a10-469d-87fd-ddb51dcf0ba1 tempest-VolumesAdminNegativeTest-1256026376 None] Created volume successfully. Sep 10 17:28:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-f765f8a9-fd39-4db9-94a6-36b4b17a56ff req-c97862d8-10d4-44ae-abe6-ae604826154b tempest-DeleteServersTestJSON-871789225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:28:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-f765f8a9-fd39-4db9-94a6-36b4b17a56ff req-c97862d8-10d4-44ae-abe6-ae604826154b tempest-DeleteServersTestJSON-871789225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:28:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-f765f8a9-fd39-4db9-94a6-36b4b17a56ff req-c97862d8-10d4-44ae-abe6-ae604826154b tempest-DeleteServersTestJSON-871789225 None] Terminate volume connection completed successfully. Sep 10 17:28:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-f765f8a9-fd39-4db9-94a6-36b4b17a56ff req-c97862d8-10d4-44ae-abe6-ae604826154b tempest-DeleteServersTestJSON-871789225 None] Deleting attachment 4b4277e1-36cc-4555-88d5-62e53e6317c2. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:28:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Acquiring lock "cinder-c11e78d6-f08e-402e-b36a-fa4936d70199-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:28:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Lock "cinder-c11e78d6-f08e-402e-b36a-fa4936d70199-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:28:35 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:28:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Acquiring lock "cinder-quobyte-c11e78d6-f08e-402e-b36a-fa4936d70199" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:28:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Lock "cinder-quobyte-c11e78d6-f08e-402e-b36a-fa4936d70199" acquired by "delete_volume" :: waited 0.022s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:28:35 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[43db1756-dcec-4600-8766-54fa3e2765fe]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:28:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c11e78d6-f08e-402e-b36a-fa4936d70199 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c11e78d6-f08e-402e-b36a-fa4936d70199" returned: 0 in 0.715s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c11e78d6-f08e-402e-b36a-fa4936d70199 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c11e78d6-f08e-402e-b36a-fa4936d70199" returned: 0 in 0.183s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Lock "cinder-quobyte-c11e78d6-f08e-402e-b36a-fa4936d70199" released by "delete_volume" :: held 1.146s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:28:36 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Created reservations ['ec7fb327-5c25-46ea-beca-780141ff67cc', '5c67d26e-3b2d-45a5-bd38-3d20f22f0bf5', '973adbc8-6e6a-4737-9a0e-a7805cdf4572', '550ed4f6-e83f-4036-a0bd-ab9b436c377c'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.106s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:28:37 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Deleted volume successfully. Sep 10 17:28:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7f5f4772-4011-4e9e-b6ce-900c6bc6f21c tempest-VolumesAdminNegativeTest-1256026376 None] Lock "cinder-c11e78d6-f08e-402e-b36a-fa4936d70199-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:28:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Acquiring lock "cinder-a332eec4-32b2-47bf-aef5-a4e0e2c209e7-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:28:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Lock "cinder-a332eec4-32b2-47bf-aef5-a4e0e2c209e7-delete_volume" acquired by "delete_volume" :: waited 0.292s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:28:39 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:28:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Acquiring lock "cinder-quobyte-a332eec4-32b2-47bf-aef5-a4e0e2c209e7" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:28:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Lock "cinder-quobyte-a332eec4-32b2-47bf-aef5-a4e0e2c209e7" acquired by "delete_volume" :: waited 0.051s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:28:39 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d64000-ec3e-4482-be24-bf21f99417b0]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:28:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7" returned: 0 in 0.856s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a332eec4-32b2-47bf-aef5-a4e0e2c209e7" returned: 0 in 0.110s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Lock "cinder-quobyte-a332eec4-32b2-47bf-aef5-a4e0e2c209e7" released by "delete_volume" :: held 1.222s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Created reservations ['b1c7aca7-1ee0-46b2-9445-ab395b3bde1a', 'a024e5c2-1d71-4ac3-a68e-cdf303ef64a6', 'bc3ce9f0-1eef-47d6-a9f0-f338acf45eb7', '58f90116-b8e7-4e3e-b905-4f37038f7f2e'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.164s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:28:41 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:28:41 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Deleted volume successfully. Sep 10 17:28:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-009feb1c-dd67-47b3-adc6-98e755e3146e tempest-DeleteServersTestJSON-871789225 None] Lock "cinder-a332eec4-32b2-47bf-aef5-a4e0e2c209e7-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:28:51 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=22,cinder:SELECT=16,cinder:INSERT=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:28:52 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=5 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.197s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:29:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:29:29 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:29:53 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Flow 'volume_create_manager' (c059ac73-905b-427e-aed4-462d9d43afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26973eb-6231-4b33-a034-fb0d226e6476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26973eb-6231-4b33-a034-fb0d226e6476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-143684635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b5352f-ce4f-42c2-89c3-f5b91b334729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ebff69bef374fd4ae1bf20483d939f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:29:53Z,use_quota=True,user_id='1dc54b445bcd42ad825c04ddc6e898e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d47d625-d63b-4402-9990-4544e12c86d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d47d625-d63b-4402-9990-4544e12c86d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f02b27e-9d32-4fcb-85cd-6d16fe1c62de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f02b27e-9d32-4fcb-85cd-6d16fe1c62de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14b5352f-ce4f-42c2-89c3-f5b91b334729', 'volume_name': 'volume-14b5352f-ce4f-42c2-89c3-f5b91b334729', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb99b94-af09-47a4-9e2a-5fb164c930fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb99b94-af09-47a4-9e2a-5fb164c930fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3665a1e-d4b5-4e8c-a0d6-2933823d1a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:29:53 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Volume 14b5352f-ce4f-42c2-89c3-f5b91b334729: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14b5352f-ce4f-42c2-89c3-f5b91b334729', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 17:29:53 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Cloning 14b5352f-ce4f-42c2-89c3-f5b91b334729 from image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 at location (None, None). {{(pid=82609) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 17:29:54 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 17:29:54 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Image download 20.69 MB at 20.69 MB/s Sep 10 17:29:54 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9892ee-8450-4543-a9d6-5ca4bceaf92a]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:29:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:29:55 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD Sep 10 17:29:55 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:29:58 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Sep 10 17:29:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD" returned: 0 in 3.884s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:29:58 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Temporary image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 is fetched for user 1dc54b445bcd42ad825c04ddc6e898e0. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 17:29:58 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[849d976f-cc49-4d80-b594-135f9fe4a2a3]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:29:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:29:59 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD Sep 10 17:29:59 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:30:01 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD" returned: 0 in 2.858s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-143684635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b5352f-ce4f-42c2-89c3-f5b91b334729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ebff69bef374fd4ae1bf20483d939f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:29:53Z,use_quota=True,user_id='1dc54b445bcd42ad825c04ddc6e898e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Creating volume 14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:30:01 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:30:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:02 devstack quobyte-client[82625]: System call of process 86657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:30:02 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=7, name=volume-14b5352f-ce4f-42c2-89c3-f5b91b334729, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:30:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 1073741824" returned: 0 in 0.629s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 0 in 0.154s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] <== create_volume: return (947ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:30:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:03 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Attempting download of 36810fdd-7157-4a06-a4dd-33f26a5e8f64 ((None, None)) to volume 14b5352f-ce4f-42c2-89c3-f5b91b334729. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 17:30:03 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[490e1fde-94d7-4833-9141-cf957d9859dd]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:30:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64__rve19hp {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64__rve19hp" returned: 0 in 0.707s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64__rve19hp {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64__rve19hp" returned: 1 in 0.986s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64__rve19hp' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:30:05 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a99309-4caa-45a9-ba73-62ad2c5f14ea]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:30:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:06 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] 36810fdd-7157-4a06-a4dd-33f26a5e8f64 was qcow2, converting to raw {{(pid=82609) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 17:30:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:06 devstack quobyte-client[82625]: System call of process 86715 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:30:06 devstack quobyte-client[82625]: System call of process 86715 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:30:06 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=7, name=volume-14b5352f-ce4f-42c2-89c3-f5b91b334729, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:30:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 0 in 1.600s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:08 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_8wy7gtwrdevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:30:08 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Converted 112.00 MB image at 68.15 MB/s Sep 10 17:30:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 1G" returned: 0 in 0.325s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:08 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947b0a4-03fd-4618-b21c-db612721165c]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:30:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 0 in 0.775s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 1 in 0.673s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Downloaded image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 ((None, None)) to volume 14b5352f-ce4f-42c2-89c3-f5b91b334729 successfully. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Temporary image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 for user 1dc54b445bcd42ad825c04ddc6e898e0 is deleted. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Marking volume 14b5352f-ce4f-42c2-89c3-f5b91b334729 as bootable. {{(pid=82609) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Copying metadata from image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 to 14b5352f-ce4f-42c2-89c3-f5b91b334729. {{(pid=82609) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Creating volume glance metadata for volume 14b5352f-ce4f-42c2-89c3-f5b91b334729 backed by image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82609) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3665a1e-d4b5-4e8c-a0d6-2933823d1a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b5352f-ce4f-42c2-89c3-f5b91b334729', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cad456-73b5-45cf-9939-216df05ace9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:10 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Volume volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 (14b5352f-ce4f-42c2-89c3-f5b91b334729): created successfully Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cad456-73b5-45cf-9939-216df05ace9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Flow 'volume_create_manager' (c059ac73-905b-427e-aed4-462d9d43afd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:11 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-e915a988-a73d-4ecf-97c7-63a4ede76c08 tempest-TaggedBootDevicesTest-1936658031 None] Created volume successfully. Sep 10 17:30:12 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Flow 'volume_create_manager' (0b3c2c17-23a5-45cf-8f65-bf806076fa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737b6b27-90f2-4cf2-94bf-b3e000a2ecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737b6b27-90f2-4cf2-94bf-b3e000a2ecf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-712835002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd64a881-cdd8-4671-9922-916894dbe0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ebff69bef374fd4ae1bf20483d939f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:12Z,use_quota=True,user_id='1dc54b445bcd42ad825c04ddc6e898e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eda065d-5508-494f-bd14-fe02011ac055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eda065d-5508-494f-bd14-fe02011ac055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff02e3f4-1547-4382-8e87-6641b7f00e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff02e3f4-1547-4382-8e87-6641b7f00e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd64a881-cdd8-4671-9922-916894dbe0ee', 'volume_name': 'volume-cd64a881-cdd8-4671-9922-916894dbe0ee', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fab545e-216d-401a-b05e-737b6d7a3b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fab545e-216d-401a-b05e-737b6d7a3b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389c2b05-c37d-4a07-bc21-a229f930defb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:12 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Volume cd64a881-cdd8-4671-9922-916894dbe0ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd64a881-cdd8-4671-9922-916894dbe0ee', 'volume_size': 1} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-712835002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd64a881-cdd8-4671-9922-916894dbe0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ebff69bef374fd4ae1bf20483d939f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:12Z,use_quota=True,user_id='1dc54b445bcd42ad825c04ddc6e898e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Creating volume cd64a881-cdd8-4671-9922-916894dbe0ee {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:30:12 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:30:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:12 devstack quobyte-client[82625]: System call of process 86734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:30:12 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=8, name=volume-cd64a881-cdd8-4671-9922-916894dbe0ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:30:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee 1073741824" returned: 0 in 0.556s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee" returned: 0 in 0.172s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:13 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] <== create_volume: return (864ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:30:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389c2b05-c37d-4a07-bc21-a229f930defb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd64a881-cdd8-4671-9922-916894dbe0ee', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4257043-4a21-4269-b380-8bb7a8c0b880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:14 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Volume volume-cd64a881-cdd8-4671-9922-916894dbe0ee (cd64a881-cdd8-4671-9922-916894dbe0ee): created successfully Sep 10 17:30:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4257043-4a21-4269-b380-8bb7a8c0b880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Flow 'volume_create_manager' (0b3c2c17-23a5-45cf-8f65-bf806076fa32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:14 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-53c62d73-1e5f-4178-bdda-1e7398f1474b tempest-TaggedBootDevicesTest-1936658031 None] Created volume successfully. Sep 10 17:30:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Flow 'volume_create_manager' (43398320-89cc-4b3b-a6df-680e8721ed13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a431ebe-adc5-4b53-ab01-3dcc7cc8dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a431ebe-adc5-4b53-ab01-3dcc7cc8dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-639064222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292b60ab84fd4d72930bfc86a78eea8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:15Z,use_quota=True,user_id='30a96890bfe24c3d97033bafa903a710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23345335-393f-4d69-95b5-3525141d0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23345335-393f-4d69-95b5-3525141d0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774ebd6-9129-46ae-82d7-b4c2e991f845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774ebd6-9129-46ae-82d7-b4c2e991f845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4', 'volume_name': 'volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5b1629-98e9-424e-80ab-5cc70ecc95fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5b1629-98e9-424e-80ab-5cc70ecc95fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b604f9-dd09-47fb-a43a-8b856a31f61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:15 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume 003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4', 'volume_size': 1} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-639064222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292b60ab84fd4d72930bfc86a78eea8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:15Z,use_quota=True,user_id='30a96890bfe24c3d97033bafa903a710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Creating volume 003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:30:15 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:30:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:16 devstack quobyte-client[82625]: System call of process 86740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:30:16 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=9, name=volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:30:16 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:30:16 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:30:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Flow 'volume_create_manager' (be89fbb7-6d9d-47c1-b470-2e1d0e4e675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96675d10-d4b5-4773-9a52-38049c2c4af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4 1073741824" returned: 0 in 0.817s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96675d10-d4b5-4773-9a52-38049c2c4af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-478330431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620eebf8-dff5-4ad2-b566-a1e8810bfb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ebff69bef374fd4ae1bf20483d939f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:16Z,use_quota=True,user_id='1dc54b445bcd42ad825c04ddc6e898e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb33fcc-bc11-4b2c-a15f-840a6c89ccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb33fcc-bc11-4b2c-a15f-840a6c89ccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7656c4dc-1dda-44ad-b2ab-1c1cfbbbb710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7656c4dc-1dda-44ad-b2ab-1c1cfbbbb710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620eebf8-dff5-4ad2-b566-a1e8810bfb60', 'volume_name': 'volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792a266b-1dc1-4f62-b757-1837a6e37a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792a266b-1dc1-4f62-b757-1837a6e37a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f249972f-7758-4006-ab79-0e69f24598eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:17 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Volume 620eebf8-dff5-4ad2-b566-a1e8810bfb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60', 'volume_size': 1} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4" returned: 0 in 0.626s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] <== create_volume: return (1466ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-478330431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620eebf8-dff5-4ad2-b566-a1e8810bfb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ebff69bef374fd4ae1bf20483d939f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:16Z,use_quota=True,user_id='1dc54b445bcd42ad825c04ddc6e898e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Creating volume 620eebf8-dff5-4ad2-b566-a1e8810bfb60 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:30:17 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:30:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:17 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=10, name=volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b604f9-dd09-47fb-a43a-8b856a31f61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4be190-310b-4cde-b794-e695a1899727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60 1073741824" returned: 0 in 0.790s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:18 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4 (003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4): created successfully Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4be190-310b-4cde-b794-e695a1899727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Flow 'volume_create_manager' (43398320-89cc-4b3b-a6df-680e8721ed13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60" returned: 0 in 0.526s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] <== create_volume: return (1343ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:18 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-938cf97f-8b26-4ea6-b643-0d9cbc62b741 tempest-AttachVolumeShelveTestJSON-1773656341 None] Created volume successfully. Sep 10 17:30:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f249972f-7758-4006-ab79-0e69f24598eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67084c75-e5d3-48ce-bce5-a5a723151f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:19 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Volume volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60 (620eebf8-dff5-4ad2-b566-a1e8810bfb60): created successfully Sep 10 17:30:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67084c75-e5d3-48ce-bce5-a5a723151f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Flow 'volume_create_manager' (be89fbb7-6d9d-47c1-b470-2e1d0e4e675d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-02cb0a44-90ca-4b7e-b998-8ec97ff8ad23 tempest-TaggedBootDevicesTest-1936658031 None] Created volume successfully. Sep 10 17:30:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:30:24 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:30:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Flow 'volume_create_manager' (dd132155-5870-45f4-88ca-ca9d0f8a8e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dd930a-217c-4a07-8c88-c798da52e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dd930a-217c-4a07-8c88-c798da52e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-948192473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38130e6a-4f66-4a59-b312-11c4dd302564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fa228d0982416298e7ae68aa509ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:24Z,use_quota=True,user_id='4c435bb7b2ec45f286b8eb77f5cc623a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea66038-6f95-4a0a-b4e5-939b742b8e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea66038-6f95-4a0a-b4e5-939b742b8e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e3ed95-2564-4d6a-9603-1fe917f4a5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e3ed95-2564-4d6a-9603-1fe917f4a5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38130e6a-4f66-4a59-b312-11c4dd302564', 'volume_name': 'volume-38130e6a-4f66-4a59-b312-11c4dd302564', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df7dc91-0472-4ede-af5a-efc10eca082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df7dc91-0472-4ede-af5a-efc10eca082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7beba189-09eb-4ef8-9a87-0d46a6c5ef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:25 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Volume 38130e6a-4f66-4a59-b312-11c4dd302564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38130e6a-4f66-4a59-b312-11c4dd302564', 'volume_size': 1} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-948192473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38130e6a-4f66-4a59-b312-11c4dd302564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fa228d0982416298e7ae68aa509ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:24Z,use_quota=True,user_id='4c435bb7b2ec45f286b8eb77f5cc623a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Creating volume 38130e6a-4f66-4a59-b312-11c4dd302564 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:30:25 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:25 devstack quobyte-client[82625]: System call of process 86791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:30:25 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=11, name=volume-38130e6a-4f66-4a59-b312-11c4dd302564, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564 1073741824" returned: 0 in 0.542s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564" returned: 0 in 0.123s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] <== create_volume: return (751ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:30:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7beba189-09eb-4ef8-9a87-0d46a6c5ef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38130e6a-4f66-4a59-b312-11c4dd302564', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f6971c-de95-4d2e-b6fa-91f3e565e759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:30:26 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Volume volume-38130e6a-4f66-4a59-b312-11c4dd302564 (38130e6a-4f66-4a59-b312-11c4dd302564): created successfully Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f6971c-de95-4d2e-b6fa-91f3e565e759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Flow 'volume_create_manager' (dd132155-5870-45f4-88ca-ca9d0f8a8e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:30:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3ae39277-26fc-4e82-a28b-2f83c72de318 tempest-TaggedAttachmentsTest-602369550 None] Created volume successfully. Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.156s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:30:36 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:30:36 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=11,cinder:SELECT=18,cinder:INSERT=13,cinder:DELETE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:30:41 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-39d05ad9-a27d-48fd-9d10-babdeed3db35 req-fec2f350-4454-4b83-b7fc-1fe00df65ad3 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:30:41 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-39d05ad9-a27d-48fd-9d10-babdeed3db35 req-fec2f350-4454-4b83-b7fc-1fe00df65ad3 tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:30:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-39d05ad9-a27d-48fd-9d10-babdeed3db35 req-fec2f350-4454-4b83-b7fc-1fe00df65ad3 tempest-AttachVolumeShelveTestJSON-1773656341 None] No connector for attachment 4ef05996-e6fa-4710-af06-9f35cfa1253f; skipping storage backend terminate_connection call. {{(pid=82609) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 10 17:30:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-39d05ad9-a27d-48fd-9d10-babdeed3db35 req-fec2f350-4454-4b83-b7fc-1fe00df65ad3 tempest-AttachVolumeShelveTestJSON-1773656341 None] Deleting attachment 4ef05996-e6fa-4710-af06-9f35cfa1253f. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:30:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:30:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:30:51 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8b0274-1dff-4cb5-9e1d-7c4d0ca21efe]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:30:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:52 devstack quobyte-client[82625]: System call of process 86839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:30:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 0 in 0.754s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:30:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 1 in 1.158s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:30:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:30:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.218s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:30:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-14b5352f-ce4f-42c2-89c3-f5b91b334729', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '878cc4eb-bd18-49d5-bf03-23be9b7e7b86', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:30:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:30:55 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-f0a92d1d-2fb3-4116-8079-273ec1d57452 tempest-TaggedBootDevicesTest-1936658031 None] attachment_update completed successfully. Sep 10 17:31:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-2de0bf5c-ebb1-4f40-9207-9c32881a9de4 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:31:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-2de0bf5c-ebb1-4f40-9207-9c32881a9de4 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:31:01 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[65577eab-0ac2-4d50-8065-51b593a2dcad]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:31:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-2de0bf5c-ebb1-4f40-9207-9c32881a9de4 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:31:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-2de0bf5c-ebb1-4f40-9207-9c32881a9de4 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee" returned: 0 in 1.687s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:31:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-2de0bf5c-ebb1-4f40-9207-9c32881a9de4 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.045s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:31:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-2de0bf5c-ebb1-4f40-9207-9c32881a9de4 tempest-TaggedBootDevicesTest-1936658031 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-cd64a881-cdd8-4671-9922-916894dbe0ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '228bc4ad-f351-48f2-906f-5250f9dc1c11', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:31:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-2de0bf5c-ebb1-4f40-9207-9c32881a9de4 tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:31:05 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-2de0bf5c-ebb1-4f40-9207-9c32881a9de4 tempest-TaggedBootDevicesTest-1936658031 None] attachment_update completed successfully. Sep 10 17:31:15 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:31:15 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:31:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-e57c2577-968b-43a7-93e6-663b43a792dc tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:31:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-e57c2577-968b-43a7-93e6-663b43a792dc tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.021s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:31:16 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c23a40-0cfe-40e2-b661-32b409a159b5]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:31:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-e57c2577-968b-43a7-93e6-663b43a792dc tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:31:18 devstack quobyte-client[82625]: System call of process 87018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:31:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-e57c2577-968b-43a7-93e6-663b43a792dc tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60" returned: 0 in 2.399s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:31:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-e57c2577-968b-43a7-93e6-663b43a792dc tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.616s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:31:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-e57c2577-968b-43a7-93e6-663b43a792dc tempest-TaggedBootDevicesTest-1936658031 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39355ab4-1de3-49a5-bbdf-97b0210c4908', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:31:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-e57c2577-968b-43a7-93e6-663b43a792dc tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:31:20 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-c280dc37-11a2-467c-8a9a-101459d79f0b req-e57c2577-968b-43a7-93e6-663b43a792dc tempest-TaggedBootDevicesTest-1936658031 None] attachment_update completed successfully. Sep 10 17:31:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:31:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:31:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:31:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:31:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:31:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:31:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:31:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.374s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:31:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:31:30 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:31:30 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:32:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:32:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:32:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:32:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:32:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:32:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:32:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:32:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.359s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:32:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:32:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-386a5641-4917-447e-ae21-d394b6da52ef req-01705559-3ae4-41c7-a666-30e57f96f884 tempest-TaggedAttachmentsTest-602369550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:32:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-386a5641-4917-447e-ae21-d394b6da52ef req-01705559-3ae4-41c7-a666-30e57f96f884 tempest-TaggedAttachmentsTest-602369550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.022s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:32:53 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b8ed77-0810-4b53-875c-5e3b88abc13c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:32:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-386a5641-4917-447e-ae21-d394b6da52ef req-01705559-3ae4-41c7-a666-30e57f96f884 tempest-TaggedAttachmentsTest-602369550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:32:54 devstack quobyte-client[82625]: System call of process 88175 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:32:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-386a5641-4917-447e-ae21-d394b6da52ef req-01705559-3ae4-41c7-a666-30e57f96f884 tempest-TaggedAttachmentsTest-602369550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564" returned: 0 in 0.954s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:32:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-386a5641-4917-447e-ae21-d394b6da52ef req-01705559-3ae4-41c7-a666-30e57f96f884 tempest-TaggedAttachmentsTest-602369550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.243s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:32:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-386a5641-4917-447e-ae21-d394b6da52ef req-01705559-3ae4-41c7-a666-30e57f96f884 tempest-TaggedAttachmentsTest-602369550 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-38130e6a-4f66-4a59-b312-11c4dd302564', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b11c62ef-fb0c-4c39-b0ad-7326ea0b0ac7', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:32:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-386a5641-4917-447e-ae21-d394b6da52ef req-01705559-3ae4-41c7-a666-30e57f96f884 tempest-TaggedAttachmentsTest-602369550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:32:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-386a5641-4917-447e-ae21-d394b6da52ef req-01705559-3ae4-41c7-a666-30e57f96f884 tempest-TaggedAttachmentsTest-602369550 None] attachment_update completed successfully. Sep 10 17:33:04 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:33:04 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:33:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "cinder-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:33:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "cinder-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:33:18 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:33:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "cinder-quobyte-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:33:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "cinder-quobyte-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4" acquired by "delete_volume" :: waited 0.036s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:33:18 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[808fd79b-054d-4f3f-b751-9e5f4c3c74a7]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:33:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:19 devstack quobyte-client[82625]: System call of process 88322 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:33:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4" returned: 0 in 0.580s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4" returned: 0 in 0.121s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "cinder-quobyte-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4" released by "delete_volume" :: held 0.881s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:33:19 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Created reservations ['b377c1ef-d341-47d2-a8f4-1f8e776a7aba', 'a4c07b18-a0df-49e9-b5a7-df7edab393dd', '1f55b51e-e629-47f2-9bc1-6e34dbcd02c5', '8f641dc0-d7c1-47a7-ae18-60fdc4ee2274'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.112s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:33:20 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Deleted volume successfully. Sep 10 17:33:20 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7617f02e-cc88-493e-907d-a58c3be7ea9e tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "cinder-003c02a2-a8f8-4f8e-8f77-c1c09bffd8e4-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:33:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "cinder-2a661fc2-b3d8-402a-8d3e-c785258f76c7-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:33:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "cinder-2a661fc2-b3d8-402a-8d3e-c785258f76c7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:33:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:33:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "cinder-quobyte-2a661fc2-b3d8-402a-8d3e-c785258f76c7" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:33:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "cinder-quobyte-2a661fc2-b3d8-402a-8d3e-c785258f76c7" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:33:21 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3418caed-d73d-4018-ad00-f774bf8a66c8]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:33:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:22 devstack quobyte-client[82625]: System call of process 88328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:33:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7" returned: 0 in 0.755s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2a661fc2-b3d8-402a-8d3e-c785258f76c7" returned: 0 in 0.180s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "cinder-quobyte-2a661fc2-b3d8-402a-8d3e-c785258f76c7" released by "delete_volume" :: held 1.203s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:33:22 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Created reservations ['5c3dab80-cbb5-450a-9f75-362618e37922', '051c0db3-837c-46ae-bba5-8c9987de066b', '53449166-644a-4d1d-b4e4-1b72fdbaeab8', 'eed94c7c-922d-42a1-9d6f-4866412be1d0'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.157s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:33:23 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Deleted volume successfully. Sep 10 17:33:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e959d5d9-41a7-44ce-9cca-a551b16a6b8d tempest-AttachVolumeShelveTestJSON-1773656341 None] Lock "cinder-2a661fc2-b3d8-402a-8d3e-c785258f76c7-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:33:26 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:33:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:33:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:33:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:33:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:33:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:33:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.228s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:33:28 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-7df8256c-2e3b-4d19-9d13-83c4f46132a9 req-7279eff6-211e-4f56-952d-0fafeeace632 tempest-TaggedAttachmentsTest-602369550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:33:29 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-7df8256c-2e3b-4d19-9d13-83c4f46132a9 req-7279eff6-211e-4f56-952d-0fafeeace632 tempest-TaggedAttachmentsTest-602369550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:33:29 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-7df8256c-2e3b-4d19-9d13-83c4f46132a9 req-7279eff6-211e-4f56-952d-0fafeeace632 tempest-TaggedAttachmentsTest-602369550 None] Terminate volume connection completed successfully. Sep 10 17:33:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-7df8256c-2e3b-4d19-9d13-83c4f46132a9 req-7279eff6-211e-4f56-952d-0fafeeace632 tempest-TaggedAttachmentsTest-602369550 None] Deleting attachment b11c62ef-fb0c-4c39-b0ad-7326ea0b0ac7. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:33:38 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=10,cinder:INSERT=6,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:33:39 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=19,cinder:SELECT=13,cinder:INSERT=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:33:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-290bb6dc-3a5c-4f13-8399-222e83cafad9 tempest-BackendsCapabilitiesAdminTestsJSON-371971027 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.8647689819336, 'free_capacity_gb': 924.8647689819336, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82609) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 10 17:33:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79149fef-80af-49c1-9995-1ee8ee361a67 tempest-BackendsCapabilitiesAdminTestsJSON-371971027 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.8647689819336, 'free_capacity_gb': 924.8647689819336, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82609) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 10 17:33:52 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-68c261ec-9d07-4528-9b0d-155fdfd92d20 tempest-GroupSnapshotsV319Test-1775057568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:33:52 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-68c261ec-9d07-4528-9b0d-155fdfd92d20 tempest-GroupSnapshotsV319Test-1775057568 None] Group tempest-GroupSnapshotsV319Test-Group-521631535: creating Sep 10 17:33:52 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-68c261ec-9d07-4528-9b0d-155fdfd92d20 tempest-GroupSnapshotsV319Test-1775057568 None] Group tempest-GroupSnapshotsV319Test-Group-521631535: created successfully Sep 10 17:33:52 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-68c261ec-9d07-4528-9b0d-155fdfd92d20 tempest-GroupSnapshotsV319Test-1775057568 None] Create group completed successfully. Sep 10 17:33:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Flow 'volume_create_manager' (2b08b297-ee2c-4022-950d-19297261cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f73c0d0-9db9-4008-8921-400241dd2c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f73c0d0-9db9-4008-8921-400241dd2c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1761285053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6226ff0c-f903-4cff-abfd-f525e12131ac,host='devstack@QuobyteHD#QuobyteHD',id=74407b5a-96d3-400d-9036-5aee3c96c4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9403dbc0f04c24b3e8c546c941b0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:33:54Z,use_quota=True,user_id='9d1e051bae694f208df4fa0fd0b081bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4926fd25-174a-4c01-9ed2-0bba4d8b9170),volume_type_id=4926fd25-174a-4c01-9ed2-0bba4d8b9170)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f8f7dd-28c0-4459-966e-df7b5e2a186b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f8f7dd-28c0-4459-966e-df7b5e2a186b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274aa29b-d48b-4a1f-ba74-d765e719eea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274aa29b-d48b-4a1f-ba74-d765e719eea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74407b5a-96d3-400d-9036-5aee3c96c4c2', 'volume_name': 'volume-74407b5a-96d3-400d-9036-5aee3c96c4c2', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a2b683-bd62-4752-be22-db0c3452442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a2b683-bd62-4752-be22-db0c3452442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663eccfb-91d9-42aa-b940-661d7357836c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:33:54 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Volume 74407b5a-96d3-400d-9036-5aee3c96c4c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74407b5a-96d3-400d-9036-5aee3c96c4c2', 'volume_size': 1} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6226ff0c-f903-4cff-abfd-f525e12131ac,created_at=2025-09-10T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1761285053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6226ff0c-f903-4cff-abfd-f525e12131ac,host='devstack@QuobyteHD#QuobyteHD',id=74407b5a-96d3-400d-9036-5aee3c96c4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9403dbc0f04c24b3e8c546c941b0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:33:54Z,use_quota=True,user_id='9d1e051bae694f208df4fa0fd0b081bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4926fd25-174a-4c01-9ed2-0bba4d8b9170),volume_type_id=4926fd25-174a-4c01-9ed2-0bba4d8b9170)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Creating volume 74407b5a-96d3-400d-9036-5aee3c96c4c2 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:33:54 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:33:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:55 devstack quobyte-client[82625]: System call of process 88376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:33:55 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=12, name=volume-74407b5a-96d3-400d-9036-5aee3c96c4c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:33:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 1073741824" returned: 0 in 0.734s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2" returned: 0 in 0.232s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] <== create_volume: return (1097ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:33:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:33:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663eccfb-91d9-42aa-b940-661d7357836c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74407b5a-96d3-400d-9036-5aee3c96c4c2', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:33:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb215d1-2c8e-4347-82b3-90d3e6bc75d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:33:56 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Volume volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 (74407b5a-96d3-400d-9036-5aee3c96c4c2): created successfully Sep 10 17:33:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb215d1-2c8e-4347-82b3-90d3e6bc75d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:33:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Flow 'volume_create_manager' (2b08b297-ee2c-4022-950d-19297261cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:33:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-569da65a-1ba9-4caa-93f4-e671a8d3ddf0 tempest-GroupSnapshotsV319Test-1775057568 None] Created volume successfully. Sep 10 17:33:57 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] GroupSnapshot 3f7388a7-edbe-4359-90eb-456b859b8f9b: creating. Sep 10 17:33:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:33:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Group snapshot 3f7388a7-edbe-4359-90eb-456b859b8f9b: creating. {{(pid=82609) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 17:33:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:33:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:33:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Creating offline snapshot a550b4e5-8b37-41a9-9587-828a8f5cda87 of volume 74407b5a-96d3-400d-9036-5aee3c96c4c2 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:33:58 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f242545e-1de1-4cb1-8b1c-6da953136f11]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:33:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2" returned: 0 in 0.795s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:59 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=13, name=volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:33:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 1G" returned: 0 in 0.364s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): qemu-img rebase -u -b volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "qemu-img rebase -u -b volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87" returned: 0 in 0.164s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:33:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:33:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:33:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87" returned: 0 in 0.154s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87" returned: 0 in 0.191s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.info" returned: 0 in 0.163s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.info" returned: 0 in 0.167s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:34:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b0fcb59e-cf4e-46d0-96f0-2bf0263f9059 tempest-GroupSnapshotsV319Test-1775057568 None] group_snapshot 3f7388a7-edbe-4359-90eb-456b859b8f9b: created successfully Sep 10 17:34:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] group_snapshot 3f7388a7-edbe-4359-90eb-456b859b8f9b: deleting Sep 10 17:34:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] group_snapshot 3f7388a7-edbe-4359-90eb-456b859b8f9b: deleting {{(pid=82609) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Acquiring lock "cinder-quobyte-74407b5a-96d3-400d-9036-5aee3c96c4c2" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Lock "cinder-quobyte-74407b5a-96d3-400d-9036-5aee3c96c4c2" acquired by "delete_snapshot" :: waited 0.075s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Acquiring lock "cinder-quobyte-a550b4e5-8b37-41a9-9587-828a8f5cda87" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Lock "cinder-quobyte-a550b4e5-8b37-41a9-9587-828a8f5cda87" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Deleting offline snapshot a550b4e5-8b37-41a9-9587-828a8f5cda87 of volume 74407b5a-96d3-400d-9036-5aee3c96c4c2 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] snapshot_file for this snap is: volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5880a1ce-2334-462e-a191-5edba5939a26]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:34:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87" returned: 0 in 0.855s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74407b5a-96d3-400d-9036-5aee3c96c4c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:34:05 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faaccbc-2b51-48c4-a4a4-e370c8e07102]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:34:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2" returned: 0 in 0.572s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:06 devstack quobyte-client[82625]: System call of process 88451 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:34:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87" returned: 0 in 0.607s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2.a550b4e5-8b37-41a9-9587-828a8f5cda87" returned: 0 in 0.276s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Lock "cinder-quobyte-a550b4e5-8b37-41a9-9587-828a8f5cda87" released by "_delete_snapshot" :: held 2.859s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:34:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Lock "cinder-quobyte-74407b5a-96d3-400d-9036-5aee3c96c4c2" released by "delete_snapshot" :: held 2.918s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:34:08 devstack cinder-volume[82609]: WARNING cinder.quota [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1088506663 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1088506663, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:34:08 devstack cinder-volume[82609]: WARNING cinder.quota [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1088506663 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1088506663, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:34:08 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] Created reservations ['abbf57eb-2ac5-41c6-997a-3d7592f77490', 'fef82fc2-bc1e-41e1-b100-f1ab56ff322a', '50fb6c70-b8af-4ffa-b4cd-8ddb52a679e2', 'cf4ff310-667a-4160-a4dd-bd2f21759b0a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:34:08 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0c593604-ad16-471c-bcc3-5f8b39f1165e tempest-GroupSnapshotsV319Test-1775057568 None] group_snapshot 3f7388a7-edbe-4359-90eb-456b859b8f9b: deleted successfully Sep 10 17:34:09 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Acquiring lock "cinder-quobyte-74407b5a-96d3-400d-9036-5aee3c96c4c2" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:34:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Lock "cinder-quobyte-74407b5a-96d3-400d-9036-5aee3c96c4c2" acquired by "delete_volume" :: waited 0.030s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:34:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f64dc3-1c36-481f-8735-20c8a21f01b7]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:34:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2" returned: 0 in 0.602s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-74407b5a-96d3-400d-9036-5aee3c96c4c2" returned: 0 in 0.154s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Lock "cinder-quobyte-74407b5a-96d3-400d-9036-5aee3c96c4c2" released by "delete_volume" :: held 1.143s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:34:11 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Created reservations ['6dd57915-5ac3-462c-b40a-c975f0fc5311'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:34:11 devstack cinder-volume[82609]: WARNING cinder.quota [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1088506663 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1088506663, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:34:11 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Created reservations ['377478d9-4a4a-4202-ad18-1f449785c4f6', '85173443-a058-4c5c-a4ce-88602737f503', '413067e6-844e-4d10-8cf9-df49fdd5bad4', '46e4f60c-2b51-4837-bce6-441f70696ae1'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:34:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:34:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:34:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:34:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:34:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:34:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.396s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:13 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:34:13 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-99e0050a-01f1-4ed7-8dfa-6a47ae95ec5d tempest-GroupSnapshotsV319Test-1775057568 None] Delete group completed successfully. Sep 10 17:34:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Acquiring lock "cinder-38130e6a-4f66-4a59-b312-11c4dd302564-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:34:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Lock "cinder-38130e6a-4f66-4a59-b312-11c4dd302564-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:34:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Acquiring lock "cinder-quobyte-38130e6a-4f66-4a59-b312-11c4dd302564" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:34:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Lock "cinder-quobyte-38130e6a-4f66-4a59-b312-11c4dd302564" acquired by "delete_volume" :: waited 0.044s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:34:21 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d49af-5ded-4c9d-b1a4-a0f2e9486439]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:34:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:22 devstack quobyte-client[82625]: System call of process 88513 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:34:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564" returned: 0 in 0.972s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-38130e6a-4f66-4a59-b312-11c4dd302564" returned: 0 in 0.146s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Lock "cinder-quobyte-38130e6a-4f66-4a59-b312-11c4dd302564" released by "delete_volume" :: held 1.368s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:34:23 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Created reservations ['3785b526-c73c-4200-9b8d-580e60205bd0', '697865fe-5c25-48e5-af05-53268f9641fb', '0cf54906-8317-4a8e-9e86-9c0b12980a73', '4e86e128-6ed6-4bf8-abe5-b5983b6bc2cb'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:34:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:34:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:34:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:34:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:34:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:34:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 1.018s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:24 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:34:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Deleted volume successfully. Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4cbf6ef1-57d8-49ba-8207-9012b1b12015 tempest-TaggedAttachmentsTest-602369550 None] Lock "cinder-38130e6a-4f66-4a59-b312-11c4dd302564-delete_volume" released by "delete_volume" :: held 6.734s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:34:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.637s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:34:33 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:INSERT=9 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:34:36 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=26,cinder:UPDATE=38,cinder:DELETE=2,cinder:INSERT=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:34:44 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Flow 'volume_create_manager' (e55ccda0-c9c2-42d4-897a-41d413699b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0425181-5517-469c-9c8f-405f97eb2db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0425181-5517-469c-9c8f-405f97eb2db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1638395602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f46736587491c8484233e27729ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:34:44Z,use_quota=True,user_id='1ff62c5d22bf44f0b98779ce65b73bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce823a1-5492-441a-b688-810e51e3cafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce823a1-5492-441a-b688-810e51e3cafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85fe6b-8f55-4757-a660-bdbb2f9be2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85fe6b-8f55-4757-a660-bdbb2f9be2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c', 'volume_name': 'volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62447cbe-7d94-4c2e-a74d-69ad0d463856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62447cbe-7d94-4c2e-a74d-69ad0d463856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8821d17-7b41-493e-8c87-4166c15eb861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:34:44 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c', 'volume_size': 1} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1638395602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f46736587491c8484233e27729ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:34:44Z,use_quota=True,user_id='1ff62c5d22bf44f0b98779ce65b73bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Creating volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:34:44 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:34:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:44 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=15, name=volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c 1073741824" returned: 0 in 0.559s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-09f9c340-0f18-4ffb-a2ee-084e7a0068bc tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" returned: 0 in 0.357s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-09f9c340-0f18-4ffb-a2ee-084e7a0068bc tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:45 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-09f9c340-0f18-4ffb-a2ee-084e7a0068bc tempest-TaggedBootDevicesTest-1936658031 None] Terminate volume connection completed successfully. Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-09f9c340-0f18-4ffb-a2ee-084e7a0068bc tempest-TaggedBootDevicesTest-1936658031 None] Deleting attachment 878cc4eb-bd18-49d5-bf03-23be9b7e7b86. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] <== create_volume: return (993ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8821d17-7b41-493e-8c87-4166c15eb861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc27d45b-1597-4e53-bccc-2aab25cac84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:34:45 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Volume volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c (40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c): created successfully Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc27d45b-1597-4e53-bccc-2aab25cac84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:34:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Flow 'volume_create_manager' (e55ccda0-c9c2-42d4-897a-41d413699b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:34:46 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-5fe70e11-0810-481c-bfc3-f6ddf0f80687 tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:46 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-5fe70e11-0810-481c-bfc3-f6ddf0f80687 tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:46 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-5fe70e11-0810-481c-bfc3-f6ddf0f80687 tempest-TaggedBootDevicesTest-1936658031 None] Terminate volume connection completed successfully. Sep 10 17:34:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-5fe70e11-0810-481c-bfc3-f6ddf0f80687 tempest-TaggedBootDevicesTest-1936658031 None] Deleting attachment 39355ab4-1de3-49a5-bbdf-97b0210c4908. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:34:46 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-61ba5430-76ce-45e3-8b39-848fda2ac421 tempest-SnapshotsActionsTest-185666754 None] Created volume successfully. Sep 10 17:34:47 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-21350460-1028-474e-831c-7d916e25600f tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:47 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-21350460-1028-474e-831c-7d916e25600f tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:47 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-21350460-1028-474e-831c-7d916e25600f tempest-TaggedBootDevicesTest-1936658031 None] Terminate volume connection completed successfully. Sep 10 17:34:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-9f980970-cba3-4980-82e9-552536bf4ef6 req-21350460-1028-474e-831c-7d916e25600f tempest-TaggedBootDevicesTest-1936658031 None] Deleting attachment 228bc4ad-f351-48f2-906f-5250f9dc1c11. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:34:48 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Creating offline snapshot a33c70e1-edbe-44e1-b556-a72fde63ccc4 of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[77051e7e-0a14-498a-b405-5deef8cb66c2]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" returned: 0 in 0.478s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:48 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=16, name=volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 1G" returned: 0 in 0.275s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:49 devstack quobyte-client[82625]: System call of process 88896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.184s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.111s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.122s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.info" returned: 0 in 0.152s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.info" returned: 0 in 0.112s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:34:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-09865488-216a-4aa9-956e-ec6cfffa6d97 tempest-SnapshotsActionsTest-185666754 None] Create snapshot completed successfully Sep 10 17:34:52 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:34:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:34:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Creating offline snapshot 8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:34:52 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32ec1e4-ef2e-4e67-bf41-0d5ba7bbaf00]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:34:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.504s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:53 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=18, name=volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 1G" returned: 0 in 0.337s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:53 devstack quobyte-client[82625]: System call of process 88912 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" returned: 0 in 0.182s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" returned: 0 in 0.105s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" returned: 0 in 0.134s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.656s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:34:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0e2f4250-6b73-4cfa-b223-4d3628d54bd9 tempest-SnapshotsActionsTest-185666754 None] Create snapshot completed successfully Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:34:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-quobyte-8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Deleting offline snapshot 8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] snapshot_file for this snap is: volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:34:54 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01d028f-f8fc-4add-bba2-14a5fc4c69e3]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:34:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" returned: 0 in 0.700s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:34:55 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e3e1c7-8862-4a30-9c67-cd0fcc3536ea]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:34:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.681s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:34:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:56 devstack quobyte-client[82625]: System call of process 88925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:34:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" returned: 0 in 0.543s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:34:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" returned: 0 in 0.137s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:34:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8" released by "_delete_snapshot" :: held 2.476s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:34:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" released by "delete_snapshot" :: held 2.511s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:34:57 devstack cinder-volume[82609]: WARNING cinder.quota [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:34:57 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Created reservations ['2c01f5a7-a297-49ee-90dd-8493999111d0', '50a0879b-763f-40a0-8cab-f454ced95b77', 'b89ee83c-a2d1-40bc-9cde-b2f081235abe', 'f337a913-9e34-4d5c-b8df-0fd62ddb2ad1'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:34:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Delete snapshot completed successfully. Sep 10 17:34:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-10813cc0-d241-49bc-8f82-b359693458f0 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-8bb40d1a-b9f3-4ccc-8bbb-78d3f19276e8-delete_snapshot" released by "delete_snapshot" :: held 3.430s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:00 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Creating offline snapshot 77cb55d8-8fac-432b-a110-ce110c118d25 of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[543fea58-cb8d-4f81-b69a-fa601a5a9a3b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "cinder-620eebf8-dff5-4ad2-b566-a1e8810bfb60-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-620eebf8-dff5-4ad2-b566-a1e8810bfb60-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:00 devstack quobyte-client[82625]: System call of process 88932 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.679s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:01 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "cinder-quobyte-620eebf8-dff5-4ad2-b566-a1e8810bfb60" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:01 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=19, name=volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-quobyte-620eebf8-dff5-4ad2-b566-a1e8810bfb60" acquired by "delete_volume" :: waited 0.152s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 1G" returned: 0 in 0.439s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b8bf26-014c-4080-8b50-c3b43d1001e4]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25" returned: 0 in 0.213s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25" returned: 0 in 0.108s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25" returned: 0 in 0.175s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60" returned: 0 in 0.847s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-620eebf8-dff5-4ad2-b566-a1e8810bfb60" returned: 0 in 0.162s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:02 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-325428a7-1517-4ee1-99cc-fc1443205885 tempest-SnapshotsActionsTest-185666754 None] Create snapshot completed successfully Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-quobyte-620eebf8-dff5-4ad2-b566-a1e8810bfb60" released by "delete_volume" :: held 1.330s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Created reservations ['46693aef-7477-402b-ba07-e72e966272ca', 'e31fc1d1-8c4a-43d3-85d4-82dc194a099d', '5ca70378-f23c-42f9-a42c-bcc76bab8b25', 'e6ae4f3f-43df-4973-8cac-2a82fc182a2a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:35:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.117s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:35:03 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Deleted volume successfully. Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a337088-cd7a-4b0b-aa86-4667c0438b76 tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-620eebf8-dff5-4ad2-b566-a1e8810bfb60-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-77cb55d8-8fac-432b-a110-ce110c118d25-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-77cb55d8-8fac-432b-a110-ce110c118d25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:03 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-quobyte-77cb55d8-8fac-432b-a110-ce110c118d25" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-77cb55d8-8fac-432b-a110-ce110c118d25" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Deleting offline snapshot 77cb55d8-8fac-432b-a110-ce110c118d25 of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] snapshot_file for this snap is: volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c1e31-b475-49eb-a970-10ee76b1b2ae]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "cinder-cd64a881-cdd8-4671-9922-916894dbe0ee-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-cd64a881-cdd8-4671-9922-916894dbe0ee-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25" returned: 0 in 0.666s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:04 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f6ccf-3669-412b-a667-066524801566]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "cinder-quobyte-cd64a881-cdd8-4671-9922-916894dbe0ee" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-quobyte-cd64a881-cdd8-4671-9922-916894dbe0ee" acquired by "delete_volume" :: waited 0.094s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:05 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[694a15ba-bf3b-4ad0-8db4-9621e0953285]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 1.052s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee" returned: 0 in 0.774s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd64a881-cdd8-4671-9922-916894dbe0ee" returned: 0 in 0.157s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25" returned: 0 in 0.624s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-quobyte-cd64a881-cdd8-4671-9922-916894dbe0ee" released by "delete_volume" :: held 1.223s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.77cb55d8-8fac-432b-a110-ce110c118d25" returned: 0 in 0.324s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-77cb55d8-8fac-432b-a110-ce110c118d25" released by "_delete_snapshot" :: held 2.920s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" released by "delete_snapshot" :: held 2.976s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Created reservations ['782642bd-6388-4b0c-b019-0350edfeddb5', '6e4e93c9-60c2-47b9-9ff0-d3d374d268de', '193d616e-83ae-4d1b-8b92-ed82afa8701d', '58364971-7379-451a-864b-b7f78b9899ea'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Created reservations ['b771c689-00f0-480f-8999-8d7bb65a915d', 'af82d6cb-6f87-4973-94c6-bc4f5cb12ab1', '8b0845ae-1a9c-4571-a73f-99689c177940', 'a1fe50f4-c4e0-42af-9033-7b70b87d5805'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:35:06 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Delete snapshot completed successfully. Sep 10 17:35:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c2a6023d-fe02-4e58-a898-18309bc1df2c tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-77cb55d8-8fac-432b-a110-ce110c118d25-delete_snapshot" released by "delete_snapshot" :: held 3.421s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.148s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:35:07 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Deleted volume successfully. Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-de76fc5a-bd55-49de-9a3d-7bc6518b3cfd tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-cd64a881-cdd8-4671-9922-916894dbe0ee-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "cinder-14b5352f-ce4f-42c2-89c3-f5b91b334729-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-14b5352f-ce4f-42c2-89c3-f5b91b334729-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:07 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "cinder-quobyte-14b5352f-ce4f-42c2-89c3-f5b91b334729" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-quobyte-14b5352f-ce4f-42c2-89c3-f5b91b334729" acquired by "delete_volume" :: waited 0.017s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:08 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ffa66f-9819-471c-a692-43669a74b04e]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 0 in 0.914s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:09 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Creating offline snapshot 6cd494bd-8ad0-42bc-9caf-fd035f2ea02a of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1eeac6-bfb0-4bee-bfb5-171384981dc1]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 1 in 0.759s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:35:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-14b5352f-ce4f-42c2-89c3-f5b91b334729" returned: 0 in 0.165s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-quobyte-14b5352f-ce4f-42c2-89c3-f5b91b334729" released by "delete_volume" :: held 2.176s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:10 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Created reservations ['3683f605-66c8-431a-89d7-34c2decdb764', 'b1746841-151e-4c28-849c-4991808ad15e', '317b5f45-ead1-453d-83a6-0dc23e8eed26', 'ba977c19-4caa-4f43-bb7c-7b98795e3cf0'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:35:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.907s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:10 devstack quobyte-client[82625]: System call of process 88979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:35:10 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=20, name=volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:35:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a 1G" returned: 0 in 0.489s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" returned: 0 in 0.362s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.265s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:11 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:35:11 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Deleted volume successfully. Sep 10 17:35:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" returned: 0 in 0.611s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:35:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-24f84297-540a-4f61-badd-f6439d0ee560 tempest-TaggedBootDevicesTest-1936658031 None] Lock "cinder-14b5352f-ce4f-42c2-89c3-f5b91b334729-delete_volume" released by "delete_volume" :: held 4.598s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" returned: 0 in 0.313s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.175s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:35:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-a0bb1ffa-6598-4a68-a9ba-1fc88ab0ca73 tempest-SnapshotsActionsTest-185666754 None] Create snapshot completed successfully Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-6cd494bd-8ad0-42bc-9caf-fd035f2ea02a-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-6cd494bd-8ad0-42bc-9caf-fd035f2ea02a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:13 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-quobyte-6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Deleting offline snapshot 6cd494bd-8ad0-42bc-9caf-fd035f2ea02a of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] snapshot_file for this snap is: volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[6222f51b-50d6-4099-9473-9cbddd0e7d0f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" returned: 0 in 0.507s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:14 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[49609862-e81b-4e3a-b01f-d327d82dbf41]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:15 devstack quobyte-client[82625]: System call of process 88991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:35:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.858s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:15 devstack quobyte-client[82625]: System call of process 89024 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:35:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" returned: 0 in 0.463s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" returned: 0 in 0.182s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:16 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-6cd494bd-8ad0-42bc-9caf-fd035f2ea02a" released by "_delete_snapshot" :: held 2.452s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:16 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" released by "delete_snapshot" :: held 2.488s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:16 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Created reservations ['ce16ae4d-5f3f-4b1f-9eb8-f629ab1ec8a5', '180c8537-ee6b-4916-a12f-92cf42b631f7', 'cff482c5-06ed-4402-ab86-3c670512f70a', '863ed3de-6655-468b-9a69-e2e2ceeabd06'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:35:16 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Delete snapshot completed successfully. Sep 10 17:35:16 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f18c4357-3989-4873-8712-3a4aa37f3fa9 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-6cd494bd-8ad0-42bc-9caf-fd035f2ea02a-delete_snapshot" released by "delete_snapshot" :: held 3.087s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:17 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:35:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:35:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Creating offline snapshot 9c51f7b8-c287-48d5-a2de-a30deb28323e of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:35:17 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[da388b6f-6f01-43bf-a4cf-158f315d6678]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:18 devstack quobyte-client[82625]: System call of process 89031 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:35:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 1.073s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:19 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=21, name=volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:35:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e 1G" returned: 0 in 0.480s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img rebase -u -b volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e" returned: 0 in 0.221s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:35:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e" returned: 0 in 0.495s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:35:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e" returned: 0 in 0.366s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.079s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:35:20 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0c6649b4-0998-4885-b4b7-e82845470de9 tempest-SnapshotsActionsTest-185666754 None] Create snapshot completed successfully Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-9c51f7b8-c287-48d5-a2de-a30deb28323e-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-9c51f7b8-c287-48d5-a2de-a30deb28323e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:22 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Acquiring lock "cinder-quobyte-9c51f7b8-c287-48d5-a2de-a30deb28323e" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-9c51f7b8-c287-48d5-a2de-a30deb28323e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Deleting offline snapshot 9c51f7b8-c287-48d5-a2de-a30deb28323e of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] snapshot_file for this snap is: volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[4679af2f-c199-4a43-b48e-e631babbddba]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:22 devstack quobyte-client[82625]: System call of process 89043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e" returned: 0 in 0.694s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[0970178f-e873-48a7-b52a-73fc79b21f15]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:23 devstack quobyte-client[82625]: System call of process 89046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:35:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.493s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:23 devstack quobyte-client[82625]: System call of process 89049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:35:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e" returned: 0 in 0.298s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.9c51f7b8-c287-48d5-a2de-a30deb28323e" returned: 0 in 0.128s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-9c51f7b8-c287-48d5-a2de-a30deb28323e" released by "_delete_snapshot" :: held 2.013s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" released by "delete_snapshot" :: held 2.050s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:24 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Created reservations ['b0a3674e-92fe-4bf4-80c4-2cff1f632a94', '6e4e3b35-a386-4d66-9907-c04c59e8e3c3', '5df80495-5f81-4da0-9a0b-4ba3bff5a13e', '876e1702-7ebc-4f90-a263-af8ce7680243'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:35:25 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Delete snapshot completed successfully. Sep 10 17:35:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-67bcb78b-ef3b-4398-9b79-f85c11070186 tempest-SnapshotsActionsTest-886752936 None] Lock "cinder-9c51f7b8-c287-48d5-a2de-a30deb28323e-delete_snapshot" released by "delete_snapshot" :: held 2.914s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "cinder-a33c70e1-edbe-44e1-b556-a72fde63ccc4-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-a33c70e1-edbe-44e1-b556-a72fde63ccc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:26 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "cinder-quobyte-a33c70e1-edbe-44e1-b556-a72fde63ccc4" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-quobyte-a33c70e1-edbe-44e1-b556-a72fde63ccc4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Deleting offline snapshot a33c70e1-edbe-44e1-b556-a72fde63ccc4 of volume 40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] snapshot_file for this snap is: volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b0a438-2feb-4dd9-86ac-dd746b126619]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.722s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ae87eb-2ad6-4dea-a1ad-da33ae8e2540]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.411s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:35:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" returned: 0 in 1.090s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.443s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c.a33c70e1-edbe-44e1-b556-a72fde63ccc4" returned: 0 in 0.328s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-quobyte-a33c70e1-edbe-44e1-b556-a72fde63ccc4" released by "_delete_snapshot" :: held 3.240s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" released by "delete_snapshot" :: held 3.295s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:30 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Created reservations ['aea05801-590d-4eb4-9f9a-9ba04b6a026f', 'baa74d6e-6271-489f-8473-f4046b910505', '0192d81f-2958-4511-a872-4d88d4af6d86', '147f8c53-371f-431d-8433-9755038f131b'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:35:30 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Delete snapshot completed successfully. Sep 10 17:35:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b77e474d-e827-415b-a308-d57c6efdc637 tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-a33c70e1-edbe-44e1-b556-a72fde63ccc4-delete_snapshot" released by "delete_snapshot" :: held 4.153s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "cinder-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:31 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:35:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:35:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" acquired by "delete_volume" :: waited 0.015s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:35:31 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2482f4-7192-4696-95fe-6a0ef5273714]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:35:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" returned: 0 in 0.771s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" returned: 0 in 0.130s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-quobyte-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c" released by "delete_volume" :: held 1.202s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Created reservations ['d7d4f950-f1a7-47eb-a314-000b24ac0d94', '4fc0c4dd-700e-426b-b75e-4ab1a17df726', 'f83af1eb-c223-4f61-9fa4-2704c52dc6cd', 'b96b1886-8308-496b-9386-640a76c86072'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.125s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:35:33 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Deleted volume successfully. Sep 10 17:35:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-678fc86f-37a2-47d0-aebe-0a82bf31079c tempest-SnapshotsActionsTest-185666754 None] Lock "cinder-40c5d7cf-fed3-4f74-ab4a-5d8c80f4c57c-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:35:43 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=80,cinder:SELECT=49,cinder:DELETE=2,cinder:INSERT=13 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:35:43 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=60,cinder:UPDATE=54,cinder:DELETE=8,cinder:INSERT=23 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.191s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:36:28 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Flow 'volume_create_manager' (6fcf8946-0cdf-4a69-b144-a1eb9d4c3052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eef59a7-c13c-47fa-9ba1-8188e5df8b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eef59a7-c13c-47fa-9ba1-8188e5df8b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1940238968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b252f3-be09-4e8c-9e12-eb981c1de4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f32d229813b413a86e4a0505b1dcb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:36:28Z,use_quota=True,user_id='38964add03204022a06a8ba41d3db2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff25753-c483-4f65-8179-d6142fe5e4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff25753-c483-4f65-8179-d6142fe5e4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9023d5b7-c876-4a76-9bff-1fb82e31d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9023d5b7-c876-4a76-9bff-1fb82e31d81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b252f3-be09-4e8c-9e12-eb981c1de4b6', 'volume_name': 'volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e0a8cc-026b-4a2a-8835-ddf063cec817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e0a8cc-026b-4a2a-8835-ddf063cec817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095201a8-1735-4453-9d76-fe9a3d24b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:28 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Volume d8b252f3-be09-4e8c-9e12-eb981c1de4b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6', 'volume_size': 1} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1940238968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b252f3-be09-4e8c-9e12-eb981c1de4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f32d229813b413a86e4a0505b1dcb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:36:28Z,use_quota=True,user_id='38964add03204022a06a8ba41d3db2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Creating volume d8b252f3-be09-4e8c-9e12-eb981c1de4b6 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:36:28 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:36:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:28 devstack quobyte-client[82625]: System call of process 89260 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:36:29 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=22, name=volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6 1073741824" returned: 0 in 0.391s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6" returned: 0 in 0.117s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] <== create_volume: return (569ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.580s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095201a8-1735-4453-9d76-fe9a3d24b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29eef89-0d29-450c-a951-6cc7e3680cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:29 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Volume volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6 (d8b252f3-be09-4e8c-9e12-eb981c1de4b6): created successfully Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29eef89-0d29-450c-a951-6cc7e3680cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Flow 'volume_create_manager' (6fcf8946-0cdf-4a69-b144-a1eb9d4c3052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:36:29 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f6468e13-3ba0-460a-ba22-eea3add6239c tempest-VolumesServicesTestJSON-784418 None] Created volume successfully. Sep 10 17:36:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Acquiring lock "cinder-d8b252f3-be09-4e8c-9e12-eb981c1de4b6-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:36:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Lock "cinder-d8b252f3-be09-4e8c-9e12-eb981c1de4b6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:36:31 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:36:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Acquiring lock "cinder-quobyte-d8b252f3-be09-4e8c-9e12-eb981c1de4b6" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:36:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Lock "cinder-quobyte-d8b252f3-be09-4e8c-9e12-eb981c1de4b6" acquired by "delete_volume" :: waited 0.019s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:36:31 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2d64c5-a0e9-40ca-aa04-cab74f2ca133]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:36:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6" returned: 0 in 0.513s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d8b252f3-be09-4e8c-9e12-eb981c1de4b6" returned: 0 in 0.099s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Lock "cinder-quobyte-d8b252f3-be09-4e8c-9e12-eb981c1de4b6" released by "delete_volume" :: held 0.782s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Created reservations ['b15196f6-0e16-4535-b158-6a26bafd9093', '24937456-fb43-454c-989e-c0906e818119', 'a02216c7-53c3-4d2c-8498-8324786b0c95', '19a19a78-789e-4e2d-8e16-0bf5c807ede1'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.096s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:32 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:36:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Deleted volume successfully. Sep 10 17:36:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-75f46fd2-de8e-453e-9cc8-8e0dda5928fa tempest-VolumesServicesTestJSON-784418 None] Lock "cinder-d8b252f3-be09-4e8c-9e12-eb981c1de4b6-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:36:42 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:36:43 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=11,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:36:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:36:45 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:36:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Flow 'volume_create_manager' (073ed13b-a5c0-4746-8d73-edb048d5ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:36:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9e5044-2854-4b09-8c60-e5a0ba98549d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9e5044-2854-4b09-8c60-e5a0ba98549d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1472957752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad977e9-37b8-4805-b784-88bf9175a23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed93b50adede4e218b5812ff989a27d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:36:46Z,use_quota=True,user_id='9d7b1100169248f4afc145f4c8337f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac32807-5ae1-440a-b70d-b7e4686010bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac32807-5ae1-440a-b70d-b7e4686010bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c00f1db-d2fd-4b7d-b27c-3c46e5408947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c00f1db-d2fd-4b7d-b27c-3c46e5408947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad977e9-37b8-4805-b784-88bf9175a23f', 'volume_name': 'volume-dad977e9-37b8-4805-b784-88bf9175a23f', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de76b780-d59d-4e87-a002-b675a74e8605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de76b780-d59d-4e87-a002-b675a74e8605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f26ebcd-820b-46ac-8f3f-51350fb30f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:46 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Volume dad977e9-37b8-4805-b784-88bf9175a23f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad977e9-37b8-4805-b784-88bf9175a23f', 'volume_size': 1} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1472957752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad977e9-37b8-4805-b784-88bf9175a23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed93b50adede4e218b5812ff989a27d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:36:46Z,use_quota=True,user_id='9d7b1100169248f4afc145f4c8337f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Creating volume dad977e9-37b8-4805-b784-88bf9175a23f {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:36:46 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:46 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=23, name=volume-dad977e9-37b8-4805-b784-88bf9175a23f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f 1073741824" returned: 0 in 0.652s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f" returned: 0 in 0.150s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] <== create_volume: return (970ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:36:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:36:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f26ebcd-820b-46ac-8f3f-51350fb30f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad977e9-37b8-4805-b784-88bf9175a23f', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70481c90-3bcf-48c0-8928-748ee0bfefcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:36:47 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Volume volume-dad977e9-37b8-4805-b784-88bf9175a23f (dad977e9-37b8-4805-b784-88bf9175a23f): created successfully Sep 10 17:36:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70481c90-3bcf-48c0-8928-748ee0bfefcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:36:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Flow 'volume_create_manager' (073ed13b-a5c0-4746-8d73-edb048d5ef89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:36:47 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4fffdc53-5d0a-4c31-b46f-ba3286925e36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Created volume successfully. Sep 10 17:36:49 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:36:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:36:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:36:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Creating offline snapshot 1ff58afa-02c8-4b25-b509-0c373a7cc5b1 of volume dad977e9-37b8-4805-b784-88bf9175a23f {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:36:49 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94e9867-a663-4784-9de4-bd164c775e9b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:36:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f" returned: 0 in 0.680s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:50 devstack quobyte-client[82625]: System call of process 89374 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:36:50 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=24, name=volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 1G" returned: 0 in 0.577s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): qemu-img rebase -u -b volume-dad977e9-37b8-4805-b784-88bf9175a23f -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "qemu-img rebase -u -b volume-dad977e9-37b8-4805-b784-88bf9175a23f -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1" returned: 0 in 0.186s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1" returned: 0 in 0.145s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1" returned: 0 in 0.141s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.info" returned: 0 in 0.133s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:36:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.info" returned: 0 in 0.145s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:36:53 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-71fea30f-175d-4871-8116-01be5947b654 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Create snapshot completed successfully Sep 10 17:36:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "cinder-1ff58afa-02c8-4b25-b509-0c373a7cc5b1-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-1ff58afa-02c8-4b25-b509-0c373a7cc5b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.244s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:36:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "cinder-quobyte-dad977e9-37b8-4805-b784-88bf9175a23f" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-quobyte-dad977e9-37b8-4805-b784-88bf9175a23f" acquired by "delete_snapshot" :: waited 0.059s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "cinder-quobyte-1ff58afa-02c8-4b25-b509-0c373a7cc5b1" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-quobyte-1ff58afa-02c8-4b25-b509-0c373a7cc5b1" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Deleting offline snapshot 1ff58afa-02c8-4b25-b509-0c373a7cc5b1 of volume dad977e9-37b8-4805-b784-88bf9175a23f {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] snapshot_file for this snap is: volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[385637e7-6e76-41df-ad5f-50a5ebb4e9f2]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:36:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:36:57 devstack quobyte-client[82625]: System call of process 89401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:36:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1" returned: 0 in 1.266s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:36:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dad977e9-37b8-4805-b784-88bf9175a23f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:36:57 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[911f6bdb-c097-4880-bf1b-9936a8aec283]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:36:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f" returned: 0 in 2.480s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:01 devstack quobyte-client[82625]: System call of process 89419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:37:01 devstack quobyte-client[82625]: System call of process 89419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:37:01 devstack quobyte-client[82625]: System call of process 89419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:37:03 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:37:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1" returned: 0 in 2.750s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:04 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:37:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Flow 'volume_create_manager' (0f37a851-da3c-41b8-80da-d09ca45381b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:37:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3726e35-387a-451f-a54e-1dbce088ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f.1ff58afa-02c8-4b25-b509-0c373a7cc5b1" returned: 0 in 1.427s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3726e35-387a-451f-a54e-1dbce088ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2121132813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032688cb-1e19-4b02-9607-8a707b8b4223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7453fbf5634495a86204ad627685e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:01Z,use_quota=True,user_id='8bd56f2625f34895b02fadcf2fea7800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b29dbf-13a1-46c4-8e16-3e369b049283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b29dbf-13a1-46c4-8e16-3e369b049283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d8ad56-31bb-4934-a6da-f4e8fc5863bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d8ad56-31bb-4934-a6da-f4e8fc5863bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032688cb-1e19-4b02-9607-8a707b8b4223', 'volume_name': 'volume-032688cb-1e19-4b02-9607-8a707b8b4223', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b915e9d3-8d04-43fb-965c-8e3bdf2ed5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b915e9d3-8d04-43fb-965c-8e3bdf2ed5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2022408e-43d9-4fa6-b0cf-733644540fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:05 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Volume 032688cb-1e19-4b02-9607-8a707b8b4223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032688cb-1e19-4b02-9607-8a707b8b4223', 'volume_size': 1} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2121132813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032688cb-1e19-4b02-9607-8a707b8b4223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7453fbf5634495a86204ad627685e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:01Z,use_quota=True,user_id='8bd56f2625f34895b02fadcf2fea7800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Creating volume 032688cb-1e19-4b02-9607-8a707b8b4223 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:37:05 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:05 devstack quobyte-client[82625]: System call of process 89438 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-quobyte-1ff58afa-02c8-4b25-b509-0c373a7cc5b1" released by "_delete_snapshot" :: held 9.529s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:05 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=26, name=volume-032688cb-1e19-4b02-9607-8a707b8b4223, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:37:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-quobyte-dad977e9-37b8-4805-b784-88bf9175a23f" released by "delete_snapshot" :: held 9.790s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223 1073741824" returned: 0 in 1.050s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223" returned: 0 in 0.634s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] <== create_volume: return (1805ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2022408e-43d9-4fa6-b0cf-733644540fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032688cb-1e19-4b02-9607-8a707b8b4223', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1bb3ca-6218-4ea8-aaca-7e3c401ce315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:07 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Volume volume-032688cb-1e19-4b02-9607-8a707b8b4223 (032688cb-1e19-4b02-9607-8a707b8b4223): created successfully Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1bb3ca-6218-4ea8-aaca-7e3c401ce315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Flow 'volume_create_manager' (0f37a851-da3c-41b8-80da-d09ca45381b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:37:07 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c938c22d-467b-4900-bd75-afc151751331 tempest-AttachVolumeNegativeTest-805605147 None] Created volume successfully. Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Created reservations ['1f54bba7-1eb2-43ff-9150-fdcc404388e1', '6db2b695-f4fe-4030-8cac-ba93083acc6d', 'a13188ca-0d3f-46c3-adea-864cdc447c36', '90d78aee-b15a-4a32-b7c3-f023d18215db'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:37:07 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Delete snapshot completed successfully. Sep 10 17:37:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d0d04113-2d88-4df1-b5e0-cfacc09cea1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-1ff58afa-02c8-4b25-b509-0c373a7cc5b1-delete_snapshot" released by "delete_snapshot" :: held 11.732s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "cinder-dad977e9-37b8-4805-b784-88bf9175a23f-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:37:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-dad977e9-37b8-4805-b784-88bf9175a23f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:37:09 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "cinder-quobyte-dad977e9-37b8-4805-b784-88bf9175a23f" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:37:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-quobyte-dad977e9-37b8-4805-b784-88bf9175a23f" acquired by "delete_volume" :: waited 0.024s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:37:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f44ff7-c822-4e15-8e5a-49e56b3e7f34]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:37:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f" returned: 0 in 0.798s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dad977e9-37b8-4805-b784-88bf9175a23f" returned: 0 in 0.223s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-quobyte-dad977e9-37b8-4805-b784-88bf9175a23f" released by "delete_volume" :: held 1.523s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:11 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Created reservations ['f6dd90fa-0fe4-4416-9b02-07d7d989cae4', '55fa9d41-d834-4f56-8d6d-2ea70fad8dc1', '8e0ca12b-a0fd-426c-826b-d0bd69b00429', '9fac6b75-8fa1-42f5-a683-0d231b13e977'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:37:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:37:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:37:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.080s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.564s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:12 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:37:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Deleted volume successfully. Sep 10 17:37:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59fac469-dfcf-42b8-9c36-fa570a635dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1351463379 None] Lock "cinder-dad977e9-37b8-4805-b784-88bf9175a23f-delete_volume" released by "delete_volume" :: held 5.046s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2b7e8e06-0d9e-4d3a-9806-f8054de0ce82 req-5b11410d-79b2-41a3-be3b-31f19bf964f9 tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2b7e8e06-0d9e-4d3a-9806-f8054de0ce82 req-5b11410d-79b2-41a3-be3b-31f19bf964f9 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:17 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73d021a-5355-4f41-b26a-f3a0650b4d62]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:37:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2b7e8e06-0d9e-4d3a-9806-f8054de0ce82 req-5b11410d-79b2-41a3-be3b-31f19bf964f9 tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2b7e8e06-0d9e-4d3a-9806-f8054de0ce82 req-5b11410d-79b2-41a3-be3b-31f19bf964f9 tempest-AttachVolumeNegativeTest-805605147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223" returned: 0 in 2.965s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2b7e8e06-0d9e-4d3a-9806-f8054de0ce82 req-5b11410d-79b2-41a3-be3b-31f19bf964f9 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.160s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-2b7e8e06-0d9e-4d3a-9806-f8054de0ce82 req-5b11410d-79b2-41a3-be3b-31f19bf964f9 tempest-AttachVolumeNegativeTest-805605147 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-032688cb-1e19-4b02-9607-8a707b8b4223', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49355ede-0076-4fea-9618-bc77ba581c67', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:37:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-2b7e8e06-0d9e-4d3a-9806-f8054de0ce82 req-5b11410d-79b2-41a3-be3b-31f19bf964f9 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-2b7e8e06-0d9e-4d3a-9806-f8054de0ce82 req-5b11410d-79b2-41a3-be3b-31f19bf964f9 tempest-AttachVolumeNegativeTest-805605147 None] attachment_update completed successfully. Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.195s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:37:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:37:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=1,cinder:UPDATE=15 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:37:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:34 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:37:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Flow 'volume_create_manager' (f10681dc-632c-42c7-86c6-764114e37a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:37:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c541d970-c973-4d67-a5f1-dd578256b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c541d970-c973-4d67-a5f1-dd578256b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1078950776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf074b90-c9cb-47ef-9e35-fbee11351569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e1c27f033d4cb2a7c1061f3d53575f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:35Z,use_quota=True,user_id='3ab8a62bccd640b9a7adedbb57945b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b50bb64-1af5-4232-959f-fe6e3074f0b1),volume_type_id=7b50bb64-1af5-4232-959f-fe6e3074f0b1)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70c34a1-2bcc-40ce-b31b-d378ff77b4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70c34a1-2bcc-40ce-b31b-d378ff77b4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cc6b43-2d1f-47e4-b5cb-2b1c45853f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cc6b43-2d1f-47e4-b5cb-2b1c45853f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf074b90-c9cb-47ef-9e35-fbee11351569', 'volume_name': 'volume-cf074b90-c9cb-47ef-9e35-fbee11351569', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b693466b-d43f-4e0e-8e75-7430750d09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b693466b-d43f-4e0e-8e75-7430750d09de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcfd251-97da-4f74-bc4e-b1b47f2620b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:35 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Volume cf074b90-c9cb-47ef-9e35-fbee11351569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf074b90-c9cb-47ef-9e35-fbee11351569', 'volume_size': 1} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1078950776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf074b90-c9cb-47ef-9e35-fbee11351569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e1c27f033d4cb2a7c1061f3d53575f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:35Z,use_quota=True,user_id='3ab8a62bccd640b9a7adedbb57945b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b50bb64-1af5-4232-959f-fe6e3074f0b1),volume_type_id=7b50bb64-1af5-4232-959f-fe6e3074f0b1)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Creating volume cf074b90-c9cb-47ef-9e35-fbee11351569 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:37:35 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cf074b90-c9cb-47ef-9e35-fbee11351569 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:35 devstack quobyte-client[82625]: System call of process 90018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:37:35 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=27, name=volume-cf074b90-c9cb-47ef-9e35-fbee11351569, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cf074b90-c9cb-47ef-9e35-fbee11351569 1073741824" returned: 0 in 0.454s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cf074b90-c9cb-47ef-9e35-fbee11351569 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cf074b90-c9cb-47ef-9e35-fbee11351569" returned: 0 in 0.137s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] <== create_volume: return (680ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:37:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcfd251-97da-4f74-bc4e-b1b47f2620b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf074b90-c9cb-47ef-9e35-fbee11351569', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc3d13b-bdae-45c2-a9b7-c15cc50ce8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:36 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Volume volume-cf074b90-c9cb-47ef-9e35-fbee11351569 (cf074b90-c9cb-47ef-9e35-fbee11351569): created successfully Sep 10 17:37:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc3d13b-bdae-45c2-a9b7-c15cc50ce8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Flow 'volume_create_manager' (f10681dc-632c-42c7-86c6-764114e37a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:37:36 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d94e4517-aa32-4310-bdaa-6d217759e728 tempest-VolumeTypesAccessTest-1352006171 None] Created volume successfully. Sep 10 17:37:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Acquiring lock "cinder-cf074b90-c9cb-47ef-9e35-fbee11351569-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:37:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Lock "cinder-cf074b90-c9cb-47ef-9e35-fbee11351569-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:37:37 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Acquiring lock "cinder-quobyte-cf074b90-c9cb-47ef-9e35-fbee11351569" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:37:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Lock "cinder-quobyte-cf074b90-c9cb-47ef-9e35-fbee11351569" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:37:37 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e44c9f-a37d-4527-8f02-f2ee98bf8d34]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:37:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cf074b90-c9cb-47ef-9e35-fbee11351569 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cf074b90-c9cb-47ef-9e35-fbee11351569" returned: 0 in 0.564s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cf074b90-c9cb-47ef-9e35-fbee11351569 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cf074b90-c9cb-47ef-9e35-fbee11351569" returned: 0 in 0.175s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Lock "cinder-quobyte-cf074b90-c9cb-47ef-9e35-fbee11351569" released by "delete_volume" :: held 1.103s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:38 devstack cinder-volume[82609]: WARNING cinder.quota [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-910053588 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-910053588, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:37:38 devstack cinder-volume[82609]: WARNING cinder.quota [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-910053588 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-910053588, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:37:38 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Created reservations ['3edaad49-2a08-4702-8c4f-a9c6db409450', 'e5ef81ad-0874-41b3-be23-f218d65d2423', '37daa688-1af4-4bde-b073-c6e7b31895ba', '51ddbb01-e58d-483a-9020-480b11c750ec'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:37:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:37:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:37:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.294s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:39 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:37:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Deleted volume successfully. Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486a536d-24a1-49df-9f7b-6eaf15a6b017 tempest-VolumeTypesAccessTest-1352006171 None] Lock "cinder-cf074b90-c9cb-47ef-9e35-fbee11351569-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Flow 'volume_create_manager' (411456b6-dcbe-4785-b55e-3186b0ed2c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b9f1c4-b52a-43ad-9f3b-a91beca35094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b9f1c4-b52a-43ad-9f3b-a91beca35094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-755127890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553b6d58-e246-4234-ad79-4d230eda69ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b52dbd754ad69dadb05769a7e51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:40Z,use_quota=True,user_id='c52baddc81824f6b8b8a4e5ccf1527cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7914726f-ede5-429b-9d15-9e187c180344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7914726f-ede5-429b-9d15-9e187c180344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d028678f-98dd-4a16-908c-094bc2ccb7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d028678f-98dd-4a16-908c-094bc2ccb7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553b6d58-e246-4234-ad79-4d230eda69ca', 'volume_name': 'volume-553b6d58-e246-4234-ad79-4d230eda69ca', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e396103-1738-4d23-9cc0-d1654a55405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e396103-1738-4d23-9cc0-d1654a55405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34efa09-8c4c-40b7-baeb-b40fd503ba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:40 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Volume 553b6d58-e246-4234-ad79-4d230eda69ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553b6d58-e246-4234-ad79-4d230eda69ca', 'volume_size': 1} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-755127890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553b6d58-e246-4234-ad79-4d230eda69ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b52dbd754ad69dadb05769a7e51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:40Z,use_quota=True,user_id='c52baddc81824f6b8b8a4e5ccf1527cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Creating volume 553b6d58-e246-4234-ad79-4d230eda69ca {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:37:41 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-553b6d58-e246-4234-ad79-4d230eda69ca 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:41 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=28, name=volume-553b6d58-e246-4234-ad79-4d230eda69ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-553b6d58-e246-4234-ad79-4d230eda69ca 1073741824" returned: 0 in 0.431s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-553b6d58-e246-4234-ad79-4d230eda69ca {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-553b6d58-e246-4234-ad79-4d230eda69ca" returned: 0 in 0.142s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] <== create_volume: return (689ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34efa09-8c4c-40b7-baeb-b40fd503ba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553b6d58-e246-4234-ad79-4d230eda69ca', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3104f983-1038-4268-a716-99cbda723f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:42 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Volume volume-553b6d58-e246-4234-ad79-4d230eda69ca (553b6d58-e246-4234-ad79-4d230eda69ca): created successfully Sep 10 17:37:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3104f983-1038-4268-a716-99cbda723f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Flow 'volume_create_manager' (411456b6-dcbe-4785-b55e-3186b0ed2c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:37:42 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8b54a604-c88a-41b8-ba6d-30f393fdc1e0 tempest-ServersNegativeTestJSON-1906712726 None] Created volume successfully. Sep 10 17:37:48 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Flow 'volume_create_manager' (546f8bff-07e2-4bd6-ab62-a8b1354650e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e621a0-a003-4f34-90d9-8556acbe9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e621a0-a003-4f34-90d9-8556acbe9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1453398047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c101735-7119-4c51-9b82-e518f79bb346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b52dbd754ad69dadb05769a7e51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:48Z,use_quota=True,user_id='c52baddc81824f6b8b8a4e5ccf1527cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d33329c-789c-41ca-90cd-12c47f136872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d33329c-789c-41ca-90cd-12c47f136872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f77f39f-7dde-4c4c-983a-ee8835970367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f77f39f-7dde-4c4c-983a-ee8835970367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c101735-7119-4c51-9b82-e518f79bb346', 'volume_name': 'volume-3c101735-7119-4c51-9b82-e518f79bb346', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85215444-9a90-4246-becf-49859cfd9b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85215444-9a90-4246-becf-49859cfd9b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54820e9d-5d3f-4376-9258-da345d8d40cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Volume 3c101735-7119-4c51-9b82-e518f79bb346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c101735-7119-4c51-9b82-e518f79bb346', 'volume_size': 1} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1453398047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c101735-7119-4c51-9b82-e518f79bb346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b52dbd754ad69dadb05769a7e51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:48Z,use_quota=True,user_id='c52baddc81824f6b8b8a4e5ccf1527cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Creating volume 3c101735-7119-4c51-9b82-e518f79bb346 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:37:48 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:37:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c101735-7119-4c51-9b82-e518f79bb346 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:48 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=29, name=volume-3c101735-7119-4c51-9b82-e518f79bb346, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:37:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c101735-7119-4c51-9b82-e518f79bb346 1073741824" returned: 0 in 0.734s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c101735-7119-4c51-9b82-e518f79bb346 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c101735-7119-4c51-9b82-e518f79bb346" returned: 0 in 0.502s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] <== create_volume: return (1404ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:37:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54820e9d-5d3f-4376-9258-da345d8d40cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c101735-7119-4c51-9b82-e518f79bb346', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af65231-cc0a-4fbb-a595-c48ad2c48b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:37:50 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Volume volume-3c101735-7119-4c51-9b82-e518f79bb346 (3c101735-7119-4c51-9b82-e518f79bb346): created successfully Sep 10 17:37:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af65231-cc0a-4fbb-a595-c48ad2c48b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:37:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Flow 'volume_create_manager' (546f8bff-07e2-4bd6-ab62-a8b1354650e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:37:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-45fde33b-8f12-4ae8-8069-e81d3fa22ceb tempest-ServersNegativeTestJSON-1906712726 None] Created volume successfully. Sep 10 17:37:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "cinder-3c101735-7119-4c51-9b82-e518f79bb346-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:37:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Lock "cinder-3c101735-7119-4c51-9b82-e518f79bb346-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:37:53 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "cinder-quobyte-3c101735-7119-4c51-9b82-e518f79bb346" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:37:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Lock "cinder-quobyte-3c101735-7119-4c51-9b82-e518f79bb346" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:37:53 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f47c305-3146-471e-a94b-22cceeb4c868]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:37:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c101735-7119-4c51-9b82-e518f79bb346 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:54 devstack quobyte-client[82625]: System call of process 90097 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:37:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c101735-7119-4c51-9b82-e518f79bb346" returned: 0 in 0.908s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c101735-7119-4c51-9b82-e518f79bb346 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c101735-7119-4c51-9b82-e518f79bb346" returned: 0 in 0.179s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Lock "cinder-quobyte-3c101735-7119-4c51-9b82-e518f79bb346" released by "delete_volume" :: held 1.337s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Created reservations ['50e2b0ce-b446-4cef-9b7e-5700e95fe62e', 'dae27760-1f07-43ba-96bd-958c6e3e3466', '20f72c6e-5dda-4493-ab0f-7074cef787a3', 'dc78d2d6-97c7-4853-ae45-da5f01d323d4'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.160s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:55 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:37:55 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Deleted volume successfully. Sep 10 17:37:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c8bd14ad-c637-421b-8b42-e0c014a6e007 tempest-ServersNegativeTestJSON-1906712726 None] Lock "cinder-3c101735-7119-4c51-9b82-e518f79bb346-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "cinder-553b6d58-e246-4234-ad79-4d230eda69ca-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:37:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Lock "cinder-553b6d58-e246-4234-ad79-4d230eda69ca-delete_volume" acquired by "delete_volume" :: waited 0.143s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:37:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:37:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "cinder-quobyte-553b6d58-e246-4234-ad79-4d230eda69ca" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:37:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Lock "cinder-quobyte-553b6d58-e246-4234-ad79-4d230eda69ca" acquired by "delete_volume" :: waited 0.027s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:37:57 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9601d32-55fa-4e6b-a810-df3356e3f1f4]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:37:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-553b6d58-e246-4234-ad79-4d230eda69ca {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-553b6d58-e246-4234-ad79-4d230eda69ca" returned: 0 in 0.603s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-553b6d58-e246-4234-ad79-4d230eda69ca {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:37:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-553b6d58-e246-4234-ad79-4d230eda69ca" returned: 0 in 0.549s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:37:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Lock "cinder-quobyte-553b6d58-e246-4234-ad79-4d230eda69ca" released by "delete_volume" :: held 1.558s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:37:59 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Created reservations ['a2edd9ec-3c1d-4374-a852-423d5f713b98', '74dd5043-6dd6-41a2-b468-6f741992d692', '2fa5414e-2287-4ee4-982f-6282f4f56b27', '4a8bb6fa-b201-4ffd-9cc3-0953404d6aa4'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:38:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:38:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:38:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:38:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:38:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:38:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.201s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:00 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:38:00 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Deleted volume successfully. Sep 10 17:38:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-63e34539-2402-4bf7-bac0-da790107e5ea tempest-ServersNegativeTestJSON-1906712726 None] Lock "cinder-553b6d58-e246-4234-ad79-4d230eda69ca-delete_volume" released by "delete_volume" :: held 4.083s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:38:10 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:38:10 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=14,cinder:UPDATE=33,cinder:DELETE=5,cinder:INSERT=7 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.267s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:38:38 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:38:38 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Flow 'volume_create_manager' (4842579d-c076-4484-80de-3dab959d0b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f2f231-8f4a-4db7-b468-34657e745d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f2f231-8f4a-4db7-b468-34657e745d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-685579911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8908c5ac-cd47-4902-a943-d8401a17379c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c110f74933bb4ff8ab701292c8eff6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:38:39Z,use_quota=True,user_id='dadc7da5b9d44f889444e6db38ac3745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2ce25d-1ee4-4961-980d-bd2ded224c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2ce25d-1ee4-4961-980d-bd2ded224c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb3dabb-091b-4c22-9213-4b76178cd61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb3dabb-091b-4c22-9213-4b76178cd61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8908c5ac-cd47-4902-a943-d8401a17379c', 'volume_name': 'volume-8908c5ac-cd47-4902-a943-d8401a17379c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3531ba83-e86c-4e37-bbbd-d99964a49ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3531ba83-e86c-4e37-bbbd-d99964a49ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5d10f0-22c8-4c5c-a537-1168972c2701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:39 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Volume 8908c5ac-cd47-4902-a943-d8401a17379c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8908c5ac-cd47-4902-a943-d8401a17379c', 'volume_size': 1} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-685579911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8908c5ac-cd47-4902-a943-d8401a17379c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c110f74933bb4ff8ab701292c8eff6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:38:39Z,use_quota=True,user_id='dadc7da5b9d44f889444e6db38ac3745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Creating volume 8908c5ac-cd47-4902-a943-d8401a17379c {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:38:39 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8908c5ac-cd47-4902-a943-d8401a17379c 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:39 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=30, name=volume-8908c5ac-cd47-4902-a943-d8401a17379c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8908c5ac-cd47-4902-a943-d8401a17379c 1073741824" returned: 0 in 0.501s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8908c5ac-cd47-4902-a943-d8401a17379c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8908c5ac-cd47-4902-a943-d8401a17379c" returned: 0 in 0.216s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] <== create_volume: return (809ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:38:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:38:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5d10f0-22c8-4c5c-a537-1168972c2701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8908c5ac-cd47-4902-a943-d8401a17379c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02603b9-d5f2-4ad7-9f9d-37106a64976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:40 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Volume volume-8908c5ac-cd47-4902-a943-d8401a17379c (8908c5ac-cd47-4902-a943-d8401a17379c): created successfully Sep 10 17:38:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02603b9-d5f2-4ad7-9f9d-37106a64976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Flow 'volume_create_manager' (4842579d-c076-4484-80de-3dab959d0b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:38:40 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-79cc6f8e-b9c9-4557-80c7-42e810359969 tempest-AbsoluteLimitsTests-1235058134 None] Created volume successfully. Sep 10 17:38:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Acquiring lock "cinder-8908c5ac-cd47-4902-a943-d8401a17379c-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:38:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Lock "cinder-8908c5ac-cd47-4902-a943-d8401a17379c-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:38:41 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:38:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Acquiring lock "cinder-quobyte-8908c5ac-cd47-4902-a943-d8401a17379c" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:38:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Lock "cinder-quobyte-8908c5ac-cd47-4902-a943-d8401a17379c" acquired by "delete_volume" :: waited 0.024s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:38:41 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d258b8-dafd-4505-aec3-bfa274f6ffd9]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:38:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8908c5ac-cd47-4902-a943-d8401a17379c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:42 devstack quobyte-client[82625]: System call of process 90312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:38:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8908c5ac-cd47-4902-a943-d8401a17379c" returned: 0 in 0.668s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8908c5ac-cd47-4902-a943-d8401a17379c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8908c5ac-cd47-4902-a943-d8401a17379c" returned: 0 in 0.288s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Lock "cinder-quobyte-8908c5ac-cd47-4902-a943-d8401a17379c" released by "delete_volume" :: held 1.289s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:38:43 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Created reservations ['ac0154e5-5098-474f-952a-4744608ddbed', 'c78a8f14-3034-4b22-a69b-42bf5714a72a', '046bf24e-8717-442e-8110-c3cf52a31c27', '9b0a4d71-9cda-4cd7-8979-c867a1b0ac62'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:38:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:38:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:38:43 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:38:43 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:38:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:38:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.495s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:44 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:38:44 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Deleted volume successfully. Sep 10 17:38:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-879657fc-34b2-416f-8720-601e16f55d82 tempest-AbsoluteLimitsTests-1235058134 None] Lock "cinder-8908c5ac-cd47-4902-a943-d8401a17379c-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:38:53 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=16,cinder:SELECT=6 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:38:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Flow 'volume_create_manager' (d37027ed-2383-4eaa-9f33-bef810f90db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67ba217-8df4-4e7e-b900-75e3c5d93005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67ba217-8df4-4e7e-b900-75e3c5d93005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1902871279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cc0899-4734-4b5f-b231-4dc3cdc8ee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b8baac56cb42fab224ecbed63a3bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:38:54Z,use_quota=True,user_id='bc5a6479047a495a9a4fd419789fcd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfd505d-898a-492c-bcb7-6ded2467dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfd505d-898a-492c-bcb7-6ded2467dab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2d65b1-ef9f-4aa9-ac79-bbe83a701ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2d65b1-ef9f-4aa9-ac79-bbe83a701ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cc0899-4734-4b5f-b231-4dc3cdc8ee25', 'volume_name': 'volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5c0392-6342-4b86-b214-f5ae1586862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5c0392-6342-4b86-b214-f5ae1586862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae90bc0-9d45-4a34-80b1-2bd98f0ae946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:54 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Volume 25cc0899-4734-4b5f-b231-4dc3cdc8ee25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25', 'volume_size': 1} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1902871279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cc0899-4734-4b5f-b231-4dc3cdc8ee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b8baac56cb42fab224ecbed63a3bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:38:54Z,use_quota=True,user_id='bc5a6479047a495a9a4fd419789fcd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Creating volume 25cc0899-4734-4b5f-b231-4dc3cdc8ee25 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:38:54 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:54 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=31, name=volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25 1073741824" returned: 0 in 0.407s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25" returned: 0 in 0.134s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] <== create_volume: return (617ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:38:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.630s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:38:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae90bc0-9d45-4a34-80b1-2bd98f0ae946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbbfb0d-6d66-4438-9d4a-b45a3db28c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:38:55 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Volume volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25 (25cc0899-4734-4b5f-b231-4dc3cdc8ee25): created successfully Sep 10 17:38:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbbfb0d-6d66-4438-9d4a-b45a3db28c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:38:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Flow 'volume_create_manager' (d37027ed-2383-4eaa-9f33-bef810f90db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:38:55 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-34dec34f-380c-4be0-8d23-a0c6398912ae tempest-VolumesMetadataTest-1751881343 None] Created volume successfully. Sep 10 17:38:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Acquiring lock "cinder-25cc0899-4734-4b5f-b231-4dc3cdc8ee25-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:38:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Lock "cinder-25cc0899-4734-4b5f-b231-4dc3cdc8ee25-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:38:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:38:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Acquiring lock "cinder-quobyte-25cc0899-4734-4b5f-b231-4dc3cdc8ee25" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:38:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Lock "cinder-quobyte-25cc0899-4734-4b5f-b231-4dc3cdc8ee25" acquired by "delete_volume" :: waited 0.032s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:38:58 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f807dec-aa17-483c-a6c8-ec19e7c94c67]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:38:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25" returned: 0 in 0.571s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:38:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-25cc0899-4734-4b5f-b231-4dc3cdc8ee25" returned: 0 in 0.147s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:38:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Lock "cinder-quobyte-25cc0899-4734-4b5f-b231-4dc3cdc8ee25" released by "delete_volume" :: held 0.895s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:38:59 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Created reservations ['992297b4-3e02-4ed0-8b67-a37aa4dafdef', 'ac9756fc-1b10-433b-8d3e-4c5c29db9da0', 'cf7264a8-5736-4c40-9bb6-b01a87300a88', '0f7b22b1-0245-41c8-a565-1d0720253dfb'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.101s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:39:00 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Deleted volume successfully. Sep 10 17:39:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92e09fe2-8a49-4158-ae95-72cde6d6163b tempest-VolumesMetadataTest-1751881343 None] Lock "cinder-25cc0899-4734-4b5f-b231-4dc3cdc8ee25-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:39:10 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:39:10 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=11,cinder:UPDATE=13,cinder:DELETE=4,cinder:INSERT=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:39:12 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Flow 'volume_create_manager' (6ecb9ebc-e31c-4572-acef-74c4b0f831cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c30077-683d-4b15-9275-1332803dbb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c30077-683d-4b15-9275-1332803dbb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1822991091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776bd5a4-0ac1-4d2f-842d-3657b8eecfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9454f4d3214560847ba6f1f0bdb575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:39:12Z,use_quota=True,user_id='131ce26f5ae3472c9bf871d1c5cd28a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0465cf0c-9012-44b2-a09a-673ad36e2a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0465cf0c-9012-44b2-a09a-673ad36e2a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97d6c72-a334-4491-aa55-6d4422743a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97d6c72-a334-4491-aa55-6d4422743a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776bd5a4-0ac1-4d2f-842d-3657b8eecfe0', 'volume_name': 'volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e1f0f3-9a1e-4df5-8b86-d6003627a126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e1f0f3-9a1e-4df5-8b86-d6003627a126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5570e21d-8d15-4022-833e-aee56b589461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:12 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Volume 776bd5a4-0ac1-4d2f-842d-3657b8eecfe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0', 'volume_size': 1} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1822991091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776bd5a4-0ac1-4d2f-842d-3657b8eecfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9454f4d3214560847ba6f1f0bdb575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:39:12Z,use_quota=True,user_id='131ce26f5ae3472c9bf871d1c5cd28a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Creating volume 776bd5a4-0ac1-4d2f-842d-3657b8eecfe0 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:39:12 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:39:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:13 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=32, name=volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:39:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0 1073741824" returned: 0 in 0.694s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0" returned: 0 in 0.222s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:13 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] <== create_volume: return (1095ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:39:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5570e21d-8d15-4022-833e-aee56b589461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e392f1-f69f-44df-b35d-e6656fb2226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:14 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Volume volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0 (776bd5a4-0ac1-4d2f-842d-3657b8eecfe0): created successfully Sep 10 17:39:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e392f1-f69f-44df-b35d-e6656fb2226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Flow 'volume_create_manager' (6ecb9ebc-e31c-4572-acef-74c4b0f831cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:39:14 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-e01698e0-79e9-45c2-823e-64495b2b5e48 tempest-VolumesTransfersV355Test-1722697292 None] Created volume successfully. Sep 10 17:39:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6d541194-20f1-4390-bb96-993c341e8eed tempest-VolumesTransfersV355Test-1414762447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:16 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6d541194-20f1-4390-bb96-993c341e8eed tempest-VolumesTransfersV355Test-1414762447 None] Transfer volume completed successfully. Sep 10 17:39:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Acquiring lock "cinder-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:39:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Lock "cinder-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:39:17 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Acquiring lock "cinder-quobyte-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:39:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Lock "cinder-quobyte-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0" acquired by "delete_volume" :: waited 0.022s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:39:17 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4300c1-19d0-45af-85a3-b649aac3e225]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:39:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:18 devstack quobyte-client[82625]: System call of process 90394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:39:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0" returned: 0 in 0.711s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0" returned: 0 in 0.372s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Lock "cinder-quobyte-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0" released by "delete_volume" :: held 1.335s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Created reservations ['1ec46b30-6aa1-4f35-8d50-510daf26c8e9', 'e26b229d-cc68-4545-9d26-df63259e4081', 'ae27bf21-0824-45e1-b01a-d3925b3f2ac0', 'e212ce4a-97a1-4c7f-b2e2-f4ddb01e3353'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.122s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:19 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:39:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Deleted volume successfully. Sep 10 17:39:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-011de5f2-7d4b-4dc6-ab31-c034ab7c7633 tempest-VolumesTransfersV355Test-1884200861 None] Lock "cinder-776bd5a4-0ac1-4d2f-842d-3657b8eecfe0-delete_volume" released by "delete_volume" :: held 3.887s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:39:22 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:22 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:39:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Flow 'volume_create_manager' (f36806b2-297f-4c22-9c76-1a554af5a72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:39:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8a0031-ceb9-41a5-b3eb-caebeb6b12fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8a0031-ceb9-41a5-b3eb-caebeb6b12fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-909701094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8d7730-730a-4d83-8361-6428175a12c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9454f4d3214560847ba6f1f0bdb575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:39:22Z,use_quota=True,user_id='131ce26f5ae3472c9bf871d1c5cd28a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327acb6c-f7d9-41bc-8a9e-e4df96f72e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327acb6c-f7d9-41bc-8a9e-e4df96f72e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f645b102-9007-4982-b3ac-6464293a2f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f645b102-9007-4982-b3ac-6464293a2f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b8d7730-730a-4d83-8361-6428175a12c6', 'volume_name': 'volume-9b8d7730-730a-4d83-8361-6428175a12c6', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc46570-ed89-425c-8227-2763dcabb245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc46570-ed89-425c-8227-2763dcabb245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665848cb-c919-49e5-9d86-81560917aaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:23 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Volume 9b8d7730-730a-4d83-8361-6428175a12c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b8d7730-730a-4d83-8361-6428175a12c6', 'volume_size': 1} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-909701094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8d7730-730a-4d83-8361-6428175a12c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9454f4d3214560847ba6f1f0bdb575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:39:22Z,use_quota=True,user_id='131ce26f5ae3472c9bf871d1c5cd28a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Creating volume 9b8d7730-730a-4d83-8361-6428175a12c6 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.080s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:39:23 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:39:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9b8d7730-730a-4d83-8361-6428175a12c6 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:24 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=33, name=volume-9b8d7730-730a-4d83-8361-6428175a12c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:39:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9b8d7730-730a-4d83-8361-6428175a12c6 1073741824" returned: 0 in 1.491s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9b8d7730-730a-4d83-8361-6428175a12c6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9b8d7730-730a-4d83-8361-6428175a12c6" returned: 0 in 0.451s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] <== create_volume: return (2290ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:39:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665848cb-c919-49e5-9d86-81560917aaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b8d7730-730a-4d83-8361-6428175a12c6', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36cda3e-c639-47d8-ad18-a8802e6d072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:26 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Volume volume-9b8d7730-730a-4d83-8361-6428175a12c6 (9b8d7730-730a-4d83-8361-6428175a12c6): created successfully Sep 10 17:39:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36cda3e-c639-47d8-ad18-a8802e6d072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Flow 'volume_create_manager' (f36806b2-297f-4c22-9c76-1a554af5a72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:39:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c850771b-81d0-44b2-ad88-b0bc2f3b7442 tempest-VolumesTransfersV355Test-1722697292 None] Created volume successfully. Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.167s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:39:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Acquiring lock "cinder-9b8d7730-730a-4d83-8361-6428175a12c6-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:39:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Lock "cinder-9b8d7730-730a-4d83-8361-6428175a12c6-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:39:29 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Acquiring lock "cinder-quobyte-9b8d7730-730a-4d83-8361-6428175a12c6" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:39:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Lock "cinder-quobyte-9b8d7730-730a-4d83-8361-6428175a12c6" acquired by "delete_volume" :: waited 0.079s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:39:29 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41aa6a-6a9b-4895-96ad-a9fe005cb317]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:39:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9b8d7730-730a-4d83-8361-6428175a12c6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9b8d7730-730a-4d83-8361-6428175a12c6" returned: 0 in 1.101s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9b8d7730-730a-4d83-8361-6428175a12c6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9b8d7730-730a-4d83-8361-6428175a12c6" returned: 0 in 0.297s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Lock "cinder-quobyte-9b8d7730-730a-4d83-8361-6428175a12c6" released by "delete_volume" :: held 1.949s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:39:32 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Created reservations ['47b2227d-c908-436d-8d17-3ed1cd20e399', '1c5d7504-095d-4d2f-82cf-0117208fb7b8', '1ba5c356-6501-41e3-8314-f07d7aa889f2', '0d5bf819-8533-4207-93f0-70134f56bc4f'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:39:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.295s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:33 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:39:33 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Deleted volume successfully. Sep 10 17:39:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-749dc231-0383-498d-8dc8-e92139266702 tempest-VolumesTransfersV355Test-1884200861 None] Lock "cinder-9b8d7730-730a-4d83-8361-6428175a12c6-delete_volume" released by "delete_volume" :: held 6.071s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:39:42 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=13,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:39:43 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=13,cinder:SELECT=13,cinder:INSERT=8,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:39:46 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Flow 'volume_create_manager' (ff35a956-17c6-44da-bae0-7a02d77685fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f00596-9087-4878-af06-e1e5ac769b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f00596-9087-4878-af06-e1e5ac769b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1662906466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be9dfa6-b224-4ea1-b169-fc9e41c819c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18932901ebdf4305874b49b0b86db149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:39:47Z,use_quota=True,user_id='bc55f0bbd39c4cdaabc9737f4f40b5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b8c008-aa1b-4dc2-87d5-6dd0b42145a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b8c008-aa1b-4dc2-87d5-6dd0b42145a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5309106c-ac45-4760-9373-dafdb148515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5309106c-ac45-4760-9373-dafdb148515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be9dfa6-b224-4ea1-b169-fc9e41c819c9', 'volume_name': 'volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b51705-c2ba-46f4-b140-d6d50bf1f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b51705-c2ba-46f4-b140-d6d50bf1f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19af7bd3-228c-43a0-999a-74ec3ab4a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:46 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Volume 5be9dfa6-b224-4ea1-b169-fc9e41c819c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9', 'volume_size': 1} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1662906466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be9dfa6-b224-4ea1-b169-fc9e41c819c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18932901ebdf4305874b49b0b86db149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:39:47Z,use_quota=True,user_id='bc55f0bbd39c4cdaabc9737f4f40b5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Creating volume 5be9dfa6-b224-4ea1-b169-fc9e41c819c9 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:39:46 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:39:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:47 devstack quobyte-client[82625]: System call of process 90581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:39:47 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=34, name=volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:39:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9 1073741824" returned: 0 in 0.485s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9" returned: 0 in 0.198s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] <== create_volume: return (778ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:39:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19af7bd3-228c-43a0-999a-74ec3ab4a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905a8b26-e55b-4a15-b3bb-05c7642e7cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Volume volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9 (5be9dfa6-b224-4ea1-b169-fc9e41c819c9): created successfully Sep 10 17:39:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905a8b26-e55b-4a15-b3bb-05c7642e7cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Flow 'volume_create_manager' (ff35a956-17c6-44da-bae0-7a02d77685fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:39:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ee09cf51-4566-4841-bb89-4aa5098af110 tempest-VolumesTransfersV357Test-1301149557 None] Created volume successfully. Sep 10 17:39:49 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c2b0099d-b316-4530-a41b-09c63280c7e3 tempest-VolumesTransfersV357Test-1949476211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:49 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c2b0099d-b316-4530-a41b-09c63280c7e3 tempest-VolumesTransfersV357Test-1949476211 None] Transfer volume completed successfully. Sep 10 17:39:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Acquiring lock "cinder-5be9dfa6-b224-4ea1-b169-fc9e41c819c9-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:39:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Lock "cinder-5be9dfa6-b224-4ea1-b169-fc9e41c819c9-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:39:51 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Acquiring lock "cinder-quobyte-5be9dfa6-b224-4ea1-b169-fc9e41c819c9" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:39:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Lock "cinder-quobyte-5be9dfa6-b224-4ea1-b169-fc9e41c819c9" acquired by "delete_volume" :: waited 0.018s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:39:51 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cc0fdc-d0cf-4463-8860-4118758cef79]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:39:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9" returned: 0 in 0.576s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5be9dfa6-b224-4ea1-b169-fc9e41c819c9" returned: 0 in 0.087s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Lock "cinder-quobyte-5be9dfa6-b224-4ea1-b169-fc9e41c819c9" released by "delete_volume" :: held 0.852s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Created reservations ['369e4651-ee75-4c06-abd7-05b963908fbf', '66497377-3cf0-4ce3-a936-56d64b5a75c8', '15bb4c75-786f-4097-a3db-cdac32d7f463', 'a8cabeb7-481f-4dbf-9f12-5de89cd8a9b9'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.083s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:52 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:39:53 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Deleted volume successfully. Sep 10 17:39:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ca17abff-3d77-42a6-9dd5-d532685b437b tempest-VolumesTransfersV357Test-1119534023 None] Lock "cinder-5be9dfa6-b224-4ea1-b169-fc9e41c819c9-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:39:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Flow 'volume_create_manager' (d99759c6-a698-41cf-a5d7-a0727c99810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c762b778-f646-4497-9678-ae867603ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c762b778-f646-4497-9678-ae867603ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1438500145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18932901ebdf4305874b49b0b86db149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:39:54Z,use_quota=True,user_id='bc55f0bbd39c4cdaabc9737f4f40b5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82670062-2a23-47e0-8ca8-cf6d2cfc84d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82670062-2a23-47e0-8ca8-cf6d2cfc84d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14deb5f0-c4fa-40cf-bf2c-0711062cf409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14deb5f0-c4fa-40cf-bf2c-0711062cf409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a', 'volume_name': 'volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cd76f1-c848-49b9-96ab-34554058757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cd76f1-c848-49b9-96ab-34554058757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f716ec5a-401a-48f7-ba3a-aaf220d1b351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:54 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Volume f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a', 'volume_size': 1} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1438500145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18932901ebdf4305874b49b0b86db149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:39:54Z,use_quota=True,user_id='bc55f0bbd39c4cdaabc9737f4f40b5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Creating volume f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:39:54 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:54 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=35, name=volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a 1073741824" returned: 0 in 0.377s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a" returned: 0 in 0.084s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] <== create_volume: return (529ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:39:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.541s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f716ec5a-401a-48f7-ba3a-aaf220d1b351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c81a68-5c9a-45a6-bdca-c2579031f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:39:55 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Volume volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a (f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a): created successfully Sep 10 17:39:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c81a68-5c9a-45a6-bdca-c2579031f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:39:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Flow 'volume_create_manager' (d99759c6-a698-41cf-a5d7-a0727c99810a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:39:55 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1445821d-c868-4a5d-9c1a-5a3c331a12c1 tempest-VolumesTransfersV357Test-1301149557 None] Created volume successfully. Sep 10 17:39:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Acquiring lock "cinder-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:39:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Lock "cinder-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:39:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:39:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Acquiring lock "cinder-quobyte-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:39:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Lock "cinder-quobyte-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a" acquired by "delete_volume" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:39:57 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[7982e4c8-ca00-4784-a69e-c6ce24953b90]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:39:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a" returned: 0 in 0.435s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a" returned: 0 in 0.160s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Lock "cinder-quobyte-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a" released by "delete_volume" :: held 0.760s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Created reservations ['e15338dc-c43c-4b15-8701-d40775c017d4', 'b7efde3f-befc-40ce-86ae-fcc686cdd3a7', '5d8b7261-5c4b-4b88-866b-9f11e6780598', 'cb5081c1-b8bc-41b5-b288-6934aa3c86c7'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.095s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:39:58 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:39:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Deleted volume successfully. Sep 10 17:39:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-406db9d5-d767-4109-8411-5dbf89db50f0 tempest-VolumesTransfersV357Test-1119534023 None] Lock "cinder-f1c9f7ed-cef7-4fc7-b8dd-bd82a7fa150a-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:40:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-bf855ffe-d97e-4719-92d2-e32540993de6 req-6feaecfa-a882-489f-8e3a-f0e02b69f3e3 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:40:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-bf855ffe-d97e-4719-92d2-e32540993de6 req-6feaecfa-a882-489f-8e3a-f0e02b69f3e3 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:40:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-bf855ffe-d97e-4719-92d2-e32540993de6 req-6feaecfa-a882-489f-8e3a-f0e02b69f3e3 tempest-AttachVolumeNegativeTest-805605147 None] Terminate volume connection completed successfully. Sep 10 17:40:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-bf855ffe-d97e-4719-92d2-e32540993de6 req-6feaecfa-a882-489f-8e3a-f0e02b69f3e3 tempest-AttachVolumeNegativeTest-805605147 None] Deleting attachment 49355ede-0076-4fea-9618-bc77ba581c67. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:40:08 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=12,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:40:11 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Flow 'volume_create_manager' (9d0fad01-ef03-4afd-be71-b932224432c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2de4167-5dab-4d9e-b82d-25e376eae657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2de4167-5dab-4d9e-b82d-25e376eae657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1178253050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa871b9-22a6-4b44-9268-4865da624293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc57a937425941e18b51c40b6b66ccf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:11Z,use_quota=True,user_id='6b371e3e3b4a4c818930320f642affef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa93915-2082-4e6b-9b88-3e859d0e3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa93915-2082-4e6b-9b88-3e859d0e3910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24834ce1-3984-42da-a4c9-be246bef8cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24834ce1-3984-42da-a4c9-be246bef8cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa871b9-22a6-4b44-9268-4865da624293', 'volume_name': 'volume-4aa871b9-22a6-4b44-9268-4865da624293', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf57138-b786-40d9-bd09-378cc2e7d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf57138-b786-40d9-bd09-378cc2e7d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2517fd75-ac86-4a4d-949f-d0862c99e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:11 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Volume 4aa871b9-22a6-4b44-9268-4865da624293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa871b9-22a6-4b44-9268-4865da624293', 'volume_size': 1} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1178253050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa871b9-22a6-4b44-9268-4865da624293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc57a937425941e18b51c40b6b66ccf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:11Z,use_quota=True,user_id='6b371e3e3b4a4c818930320f642affef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Creating volume 4aa871b9-22a6-4b44-9268-4865da624293 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:40:11 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4aa871b9-22a6-4b44-9268-4865da624293 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:40:11 devstack quobyte-client[82625]: System call of process 90698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:40:11 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=36, name=volume-4aa871b9-22a6-4b44-9268-4865da624293, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4aa871b9-22a6-4b44-9268-4865da624293 1073741824" returned: 0 in 0.526s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:40:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4aa871b9-22a6-4b44-9268-4865da624293 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:40:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4aa871b9-22a6-4b44-9268-4865da624293" returned: 0 in 0.139s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:40:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] <== create_volume: return (777ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:40:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:40:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2517fd75-ac86-4a4d-949f-d0862c99e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa871b9-22a6-4b44-9268-4865da624293', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b63c7a-b871-4418-9eaf-22ca4fda901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:12 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Volume volume-4aa871b9-22a6-4b44-9268-4865da624293 (4aa871b9-22a6-4b44-9268-4865da624293): created successfully Sep 10 17:40:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b63c7a-b871-4418-9eaf-22ca4fda901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Flow 'volume_create_manager' (9d0fad01-ef03-4afd-be71-b932224432c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:40:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4dae932f-a8e3-428d-ad92-83f09e263cd3 tempest-VolumesNegativeTest-112362894 None] Created volume successfully. Sep 10 17:40:22 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:40:22 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=20,cinder:SELECT=15,cinder:INSERT=8,cinder:DELETE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:40:44 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Flow 'volume_create_manager' (4b18399a-fe0f-4ad2-b70b-6c002ce0881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4efeab-3825-4425-bc2a-0fc8177b67d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4efeab-3825-4425-bc2a-0fc8177b67d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-530094209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62b1389-d6c4-433c-9db3-3873b8282660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013b67fa7b0a4008abac13c11a5b4cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:44Z,use_quota=True,user_id='25fc5c4c72144ed698eb08100b81a95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6221d27e-683d-4684-b94c-aa8d220466e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6221d27e-683d-4684-b94c-aa8d220466e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e1d249-1f7e-43ba-90eb-d88159ea66e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e1d249-1f7e-43ba-90eb-d88159ea66e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62b1389-d6c4-433c-9db3-3873b8282660', 'volume_name': 'volume-a62b1389-d6c4-433c-9db3-3873b8282660', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17c4c8e-7af0-454d-b099-ceff1150d25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17c4c8e-7af0-454d-b099-ceff1150d25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ff2ba2-5f09-4790-887d-8d05769a712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:44 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Volume a62b1389-d6c4-433c-9db3-3873b8282660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62b1389-d6c4-433c-9db3-3873b8282660', 'volume_size': 1} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-530094209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62b1389-d6c4-433c-9db3-3873b8282660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013b67fa7b0a4008abac13c11a5b4cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:44Z,use_quota=True,user_id='25fc5c4c72144ed698eb08100b81a95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Creating volume a62b1389-d6c4-433c-9db3-3873b8282660 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:40:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:40:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:40:45 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:40:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:40:45 devstack quobyte-client[82625]: System call of process 90867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:40:45 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=37, name=volume-a62b1389-d6c4-433c-9db3-3873b8282660, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:40:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660 1073741824" returned: 0 in 0.969s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:40:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:40:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660" returned: 0 in 0.263s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:40:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] <== create_volume: return (1405ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:40:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:40:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ff2ba2-5f09-4790-887d-8d05769a712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62b1389-d6c4-433c-9db3-3873b8282660', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b3200f-3a44-478e-b3c1-016dd94582fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:40:46 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Volume volume-a62b1389-d6c4-433c-9db3-3873b8282660 (a62b1389-d6c4-433c-9db3-3873b8282660): created successfully Sep 10 17:40:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b3200f-3a44-478e-b3c1-016dd94582fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:40:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Flow 'volume_create_manager' (4b18399a-fe0f-4ad2-b70b-6c002ce0881e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:40:47 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9db09ad3-72b3-447c-88d5-897bcdea88dc tempest-AttachVolumeTestJSON-1826446911 None] Created volume successfully. Sep 10 17:40:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-0af62fab-7bd2-4b27-9316-96991510d548 req-efca7122-e9a7-415e-a06d-d6a3932b1131 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:40:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-0af62fab-7bd2-4b27-9316-96991510d548 req-efca7122-e9a7-415e-a06d-d6a3932b1131 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:40:55 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c987dfdb-92e4-4f8f-ac3c-741da1128288]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:40:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-0af62fab-7bd2-4b27-9316-96991510d548 req-efca7122-e9a7-415e-a06d-d6a3932b1131 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:40:56 devstack quobyte-client[82625]: System call of process 91016 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:40:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-0af62fab-7bd2-4b27-9316-96991510d548 req-efca7122-e9a7-415e-a06d-d6a3932b1131 tempest-AttachVolumeTestJSON-1826446911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660" returned: 0 in 1.912s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:40:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-0af62fab-7bd2-4b27-9316-96991510d548 req-efca7122-e9a7-415e-a06d-d6a3932b1131 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.045s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:40:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-0af62fab-7bd2-4b27-9316-96991510d548 req-efca7122-e9a7-415e-a06d-d6a3932b1131 tempest-AttachVolumeTestJSON-1826446911 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-a62b1389-d6c4-433c-9db3-3873b8282660', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '872234a8-0b14-4b37-8b24-967997b18156', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:40:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-0af62fab-7bd2-4b27-9316-96991510d548 req-efca7122-e9a7-415e-a06d-d6a3932b1131 tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:40:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-0af62fab-7bd2-4b27-9316-96991510d548 req-efca7122-e9a7-415e-a06d-d6a3932b1131 tempest-AttachVolumeTestJSON-1826446911 None] attachment_update completed successfully. Sep 10 17:41:08 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=7 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:41:08 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:41:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Acquiring lock "cinder-4aa871b9-22a6-4b44-9268-4865da624293-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:41:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Lock "cinder-4aa871b9-22a6-4b44-9268-4865da624293-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:41:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:41:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Acquiring lock "cinder-quobyte-4aa871b9-22a6-4b44-9268-4865da624293" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:41:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Lock "cinder-quobyte-4aa871b9-22a6-4b44-9268-4865da624293" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:41:21 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9bd18-a8fd-4c8b-b769-ae43732a4177]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:41:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4aa871b9-22a6-4b44-9268-4865da624293 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:41:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4aa871b9-22a6-4b44-9268-4865da624293" returned: 0 in 0.761s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:41:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4aa871b9-22a6-4b44-9268-4865da624293 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:41:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4aa871b9-22a6-4b44-9268-4865da624293" returned: 0 in 0.099s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:41:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Lock "cinder-quobyte-4aa871b9-22a6-4b44-9268-4865da624293" released by "delete_volume" :: held 1.083s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Created reservations ['48ecfef0-8862-4b85-88f3-0f34e37bc181', 'd6269659-359b-4556-be56-2a827dc1c6a9', 'faad59f9-b35d-4bcc-af4f-dfb2c750b6cc', '4979c855-add5-4098-8f59-5829d5da82f3'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.110s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.262s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:41:23 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:41:23 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Deleted volume successfully. Sep 10 17:41:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-80bb63fb-3b4e-40f5-b421-0fe5e0265d03 tempest-VolumesNegativeTest-112362894 None] Lock "cinder-4aa871b9-22a6-4b44-9268-4865da624293-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.107s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.395s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:41:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:41:33 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:41:34 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:42:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Flow 'volume_create_manager' (90275601-2179-4c41-a823-088e4c543a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a1e98c-d65b-44ee-b236-efe44dc49834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a1e98c-d65b-44ee-b236-efe44dc49834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-54605437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7453fbf5634495a86204ad627685e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:42:16Z,use_quota=True,user_id='8bd56f2625f34895b02fadcf2fea7800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762894b3-eab3-46b2-9174-960d554cc86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762894b3-eab3-46b2-9174-960d554cc86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc76fa3-1c3e-4e83-8cc1-2fc28f93abd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc76fa3-1c3e-4e83-8cc1-2fc28f93abd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7', 'volume_name': 'volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6758f9a7-2209-4365-be2a-1e4b8111ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6758f9a7-2209-4365-be2a-1e4b8111ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10ff6e7-5383-497d-a049-af7904589b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:42:16 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Volume 2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7', 'volume_size': 1} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-54605437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7453fbf5634495a86204ad627685e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:42:16Z,use_quota=True,user_id='8bd56f2625f34895b02fadcf2fea7800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Creating volume 2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:42:16 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:42:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:42:16 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=38, name=volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:42:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7 1073741824" returned: 0 in 0.717s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:42:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:42:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7" returned: 0 in 0.181s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:42:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] <== create_volume: return (1035ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:42:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:42:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10ff6e7-5383-497d-a049-af7904589b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:42:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d35b9c-ff32-4339-8d64-8f6cda26ed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:42:18 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Volume volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7 (2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7): created successfully Sep 10 17:42:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d35b9c-ff32-4339-8d64-8f6cda26ed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:42:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Flow 'volume_create_manager' (90275601-2179-4c41-a823-088e4c543a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:42:18 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c73dd20a-9fe0-4788-9bb4-289fb2a05240 tempest-AttachVolumeNegativeTest-805605147 None] Created volume successfully. Sep 10 17:42:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2e07cd62-774b-43c1-ba9b-ad78815fe275 req-002f1971-b466-4b59-942c-a05b3447ec43 tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:42:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2e07cd62-774b-43c1-ba9b-ad78815fe275 req-002f1971-b466-4b59-942c-a05b3447ec43 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:42:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f234d2-1293-48d6-8c49-6a15f609c4a9]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:42:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2e07cd62-774b-43c1-ba9b-ad78815fe275 req-002f1971-b466-4b59-942c-a05b3447ec43 tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:42:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2e07cd62-774b-43c1-ba9b-ad78815fe275 req-002f1971-b466-4b59-942c-a05b3447ec43 tempest-AttachVolumeNegativeTest-805605147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7" returned: 0 in 0.559s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:42:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2e07cd62-774b-43c1-ba9b-ad78815fe275 req-002f1971-b466-4b59-942c-a05b3447ec43 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.640s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:42:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-2e07cd62-774b-43c1-ba9b-ad78815fe275 req-002f1971-b466-4b59-942c-a05b3447ec43 tempest-AttachVolumeNegativeTest-805605147 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2bb4f8f-737a-445e-911b-5d415717d52a', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:42:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-2e07cd62-774b-43c1-ba9b-ad78815fe275 req-002f1971-b466-4b59-942c-a05b3447ec43 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:42:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-2e07cd62-774b-43c1-ba9b-ad78815fe275 req-002f1971-b466-4b59-942c-a05b3447ec43 tempest-AttachVolumeNegativeTest-805605147 None] attachment_update completed successfully. Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.200s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:42:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:42:34 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:42:34 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:42:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-acacf072-80a7-46c9-9a1b-8c871536a821 req-cdea1e24-fdb8-4c18-91c6-e314991f5ee7 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:42:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-acacf072-80a7-46c9-9a1b-8c871536a821 req-cdea1e24-fdb8-4c18-91c6-e314991f5ee7 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:42:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-acacf072-80a7-46c9-9a1b-8c871536a821 req-cdea1e24-fdb8-4c18-91c6-e314991f5ee7 tempest-AttachVolumeNegativeTest-805605147 None] Terminate volume connection completed successfully. Sep 10 17:42:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-acacf072-80a7-46c9-9a1b-8c871536a821 req-cdea1e24-fdb8-4c18-91c6-e314991f5ee7 tempest-AttachVolumeNegativeTest-805605147 None] Deleting attachment b2bb4f8f-737a-445e-911b-5d415717d52a. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:43:04 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:43:13 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-5b4ec850-5b31-4782-991d-0e0c4cc4aa4a req-1f7ebb55-d871-4243-b1e4-82e0bcf1608b tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:43:13 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-5b4ec850-5b31-4782-991d-0e0c4cc4aa4a req-1f7ebb55-d871-4243-b1e4-82e0bcf1608b tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:43:13 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-5b4ec850-5b31-4782-991d-0e0c4cc4aa4a req-1f7ebb55-d871-4243-b1e4-82e0bcf1608b tempest-AttachVolumeTestJSON-1826446911 None] Terminate volume connection completed successfully. Sep 10 17:43:13 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-5b4ec850-5b31-4782-991d-0e0c4cc4aa4a req-1f7ebb55-d871-4243-b1e4-82e0bcf1608b tempest-AttachVolumeTestJSON-1826446911 None] Deleting attachment 872234a8-0b14-4b37-8b24-967997b18156. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:43:23 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.096s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:43:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:43:30 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:43:53 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Flow 'volume_create_manager' (7ce2ace5-fd1a-4e55-bbf8-ffbe20abb7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a05c8e-dea3-4a4f-9e20-cfaaf9b20e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a05c8e-dea3-4a4f-9e20-cfaaf9b20e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-81614522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d56792a-0efb-4259-aa85-1e2080894c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e957a24f584882a439e6077c526ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:43:53Z,use_quota=True,user_id='90fb073b48a046e4a54e0c84ec845637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aea9335-1850-4884-a706-1cb1158aff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aea9335-1850-4884-a706-1cb1158aff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85804fe9-d8e7-4d72-b7b6-bedc35232135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85804fe9-d8e7-4d72-b7b6-bedc35232135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d56792a-0efb-4259-aa85-1e2080894c09', 'volume_name': 'volume-4d56792a-0efb-4259-aa85-1e2080894c09', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3e0b24-e0f1-4966-89c1-0b3853984c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3e0b24-e0f1-4966-89c1-0b3853984c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342a4601-c9ea-48c4-b0ae-483a5695885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:43:53 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Volume 4d56792a-0efb-4259-aa85-1e2080894c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d56792a-0efb-4259-aa85-1e2080894c09', 'volume_size': 1} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-81614522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d56792a-0efb-4259-aa85-1e2080894c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e957a24f584882a439e6077c526ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:43:53Z,use_quota=True,user_id='90fb073b48a046e4a54e0c84ec845637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Creating volume 4d56792a-0efb-4259-aa85-1e2080894c09 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:43:53 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:43:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:43:53 devstack quobyte-client[82625]: System call of process 92815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:43:53 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=39, name=volume-4d56792a-0efb-4259-aa85-1e2080894c09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09 1073741824" returned: 0 in 0.568s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09" returned: 0 in 0.120s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] <== create_volume: return (797ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342a4601-c9ea-48c4-b0ae-483a5695885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d56792a-0efb-4259-aa85-1e2080894c09', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd49ba5-917e-48c8-887e-2de21d4fd059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:43:54 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Volume volume-4d56792a-0efb-4259-aa85-1e2080894c09 (4d56792a-0efb-4259-aa85-1e2080894c09): created successfully Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd49ba5-917e-48c8-887e-2de21d4fd059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:43:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Flow 'volume_create_manager' (7ce2ace5-fd1a-4e55-bbf8-ffbe20abb7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:43:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-68b36235-27ba-4208-bfa6-750e59ecbea0 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Created volume successfully. Sep 10 17:44:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-fd7f8a14-93cb-4f54-8890-73fe12b8052b req-848082db-952f-4162-91fb-b3501947c391 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:44:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-fd7f8a14-93cb-4f54-8890-73fe12b8052b req-848082db-952f-4162-91fb-b3501947c391 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:44:00 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[51053333-f69d-4ed2-bad9-bd719d04f256]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:44:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-fd7f8a14-93cb-4f54-8890-73fe12b8052b req-848082db-952f-4162-91fb-b3501947c391 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:44:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-fd7f8a14-93cb-4f54-8890-73fe12b8052b req-848082db-952f-4162-91fb-b3501947c391 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09" returned: 0 in 0.851s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:44:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-fd7f8a14-93cb-4f54-8890-73fe12b8052b req-848082db-952f-4162-91fb-b3501947c391 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.956s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:44:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-fd7f8a14-93cb-4f54-8890-73fe12b8052b req-848082db-952f-4162-91fb-b3501947c391 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-4d56792a-0efb-4259-aa85-1e2080894c09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7c236eb-8960-4683-a1dd-5199457bd8ff', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:44:01 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-fd7f8a14-93cb-4f54-8890-73fe12b8052b req-848082db-952f-4162-91fb-b3501947c391 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:44:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-fd7f8a14-93cb-4f54-8890-73fe12b8052b req-848082db-952f-4162-91fb-b3501947c391 tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] attachment_update completed successfully. Sep 10 17:44:11 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:44:11 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.130s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:44:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:44:37 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-7f3ffe9b-6f23-41c9-b801-65bddef00563 req-d9b408f4-1191-4229-8b42-4a96e1b15c5d tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:44:38 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-7f3ffe9b-6f23-41c9-b801-65bddef00563 req-d9b408f4-1191-4229-8b42-4a96e1b15c5d tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:44:38 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-7f3ffe9b-6f23-41c9-b801-65bddef00563 req-d9b408f4-1191-4229-8b42-4a96e1b15c5d tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Terminate volume connection completed successfully. Sep 10 17:44:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-7f3ffe9b-6f23-41c9-b801-65bddef00563 req-d9b408f4-1191-4229-8b42-4a96e1b15c5d tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Deleting attachment e7c236eb-8960-4683-a1dd-5199457bd8ff. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Acquiring lock "cinder-4d56792a-0efb-4259-aa85-1e2080894c09-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "cinder-4d56792a-0efb-4259-aa85-1e2080894c09-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:44:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Acquiring lock "cinder-quobyte-4d56792a-0efb-4259-aa85-1e2080894c09" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "cinder-quobyte-4d56792a-0efb-4259-aa85-1e2080894c09" acquired by "delete_volume" :: waited 0.016s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ca0eba-f42b-4ce5-be64-52191a0f2f27]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:44:40 devstack quobyte-client[82625]: System call of process 93347 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09" returned: 0 in 0.466s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d56792a-0efb-4259-aa85-1e2080894c09" returned: 0 in 0.099s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:44:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "cinder-quobyte-4d56792a-0efb-4259-aa85-1e2080894c09" released by "delete_volume" :: held 0.724s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Created reservations ['e0dc2d09-ca51-4cc2-b31e-3902facd6276', '5eb7e609-ea77-4259-a401-d50ba5f85053', 'ef220dea-d0d7-4609-b906-2c486130223a', 'ceda9795-e81a-4ef3-9801-947c792902d2'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.113s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:44:41 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Deleted volume successfully. Sep 10 17:44:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-486cbf2e-6571-4922-b568-bdf6ffa748ad tempest-TestServerVolumeAttachScenarioOldVersion-158577668 None] Lock "cinder-4d56792a-0efb-4259-aa85-1e2080894c09-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:44:51 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=6 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:44:51 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:44:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Flow 'volume_create_manager' (5ef4e82d-164a-4f6c-83c0-7c7cf7c8a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa0dbd7-8105-4b3e-a6bc-7846cf93eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa0dbd7-8105-4b3e-a6bc-7846cf93eff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-206512841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c15fde4-e1ae-43f9-bf57-a717a4ebad68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7453fbf5634495a86204ad627685e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:57Z,use_quota=True,user_id='8bd56f2625f34895b02fadcf2fea7800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c101d1-cf22-4781-8ad3-d66d6c2b5827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c101d1-cf22-4781-8ad3-d66d6c2b5827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de48ddcd-aee1-4fd3-ba6e-a08d0d4a60bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de48ddcd-aee1-4fd3-ba6e-a08d0d4a60bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c15fde4-e1ae-43f9-bf57-a717a4ebad68', 'volume_name': 'volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5dfbd6a-0f2a-443e-89f3-904b4a54531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5dfbd6a-0f2a-443e-89f3-904b4a54531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e45b425-90dc-4bc7-8bdf-24d59e9d3e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:44:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Volume 8c15fde4-e1ae-43f9-bf57-a717a4ebad68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68', 'volume_size': 1} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-206512841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c15fde4-e1ae-43f9-bf57-a717a4ebad68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7453fbf5634495a86204ad627685e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:57Z,use_quota=True,user_id='8bd56f2625f34895b02fadcf2fea7800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Creating volume 8c15fde4-e1ae-43f9-bf57-a717a4ebad68 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:44:57 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:44:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:44:58 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=40, name=volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:44:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68 1073741824" returned: 0 in 1.090s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:44:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:44:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68" returned: 0 in 0.789s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:44:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] <== create_volume: return (2177ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:44:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:45:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e45b425-90dc-4bc7-8bdf-24d59e9d3e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:45:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3245d09-13b4-43c9-ba57-658b07c1f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:45:01 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Volume volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68 (8c15fde4-e1ae-43f9-bf57-a717a4ebad68): created successfully Sep 10 17:45:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3245d09-13b4-43c9-ba57-658b07c1f543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:45:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Flow 'volume_create_manager' (5ef4e82d-164a-4f6c-83c0-7c7cf7c8a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:45:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0f29fc12-8bbd-4977-952d-40cb919b33ef tempest-AttachVolumeNegativeTest-805605147 None] Created volume successfully. Sep 10 17:45:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-8d497674-d8db-4229-915a-b6d3ec6fb24b req-c204a3ce-bfe3-4088-ba7c-60dbc5660133 tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:45:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-8d497674-d8db-4229-915a-b6d3ec6fb24b req-c204a3ce-bfe3-4088-ba7c-60dbc5660133 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:45:06 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6467281-d01d-40d5-b708-d184483e6263]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:45:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-8d497674-d8db-4229-915a-b6d3ec6fb24b req-c204a3ce-bfe3-4088-ba7c-60dbc5660133 tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:45:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-8d497674-d8db-4229-915a-b6d3ec6fb24b req-c204a3ce-bfe3-4088-ba7c-60dbc5660133 tempest-AttachVolumeNegativeTest-805605147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68" returned: 0 in 0.606s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:45:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-8d497674-d8db-4229-915a-b6d3ec6fb24b req-c204a3ce-bfe3-4088-ba7c-60dbc5660133 tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.686s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:45:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-8d497674-d8db-4229-915a-b6d3ec6fb24b req-c204a3ce-bfe3-4088-ba7c-60dbc5660133 tempest-AttachVolumeNegativeTest-805605147 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed69704c-82d2-46d8-a71b-e28cfde55be9', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:45:07 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-8d497674-d8db-4229-915a-b6d3ec6fb24b req-c204a3ce-bfe3-4088-ba7c-60dbc5660133 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:45:07 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-8d497674-d8db-4229-915a-b6d3ec6fb24b req-c204a3ce-bfe3-4088-ba7c-60dbc5660133 tempest-AttachVolumeNegativeTest-805605147 None] attachment_update completed successfully. Sep 10 17:45:17 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:45:17 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.177s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:45:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:45:30 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:45:30 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:45:39 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-08e6be5d-5cf7-4570-893f-96583716c8a3 req-08e2d99f-fcc9-4452-ba63-7b7535bb7804 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:45:39 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-08e6be5d-5cf7-4570-893f-96583716c8a3 req-08e2d99f-fcc9-4452-ba63-7b7535bb7804 tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:45:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-08e6be5d-5cf7-4570-893f-96583716c8a3 req-08e2d99f-fcc9-4452-ba63-7b7535bb7804 tempest-AttachVolumeNegativeTest-805605147 None] Terminate volume connection completed successfully. Sep 10 17:45:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-08e6be5d-5cf7-4570-893f-96583716c8a3 req-08e2d99f-fcc9-4452-ba63-7b7535bb7804 tempest-AttachVolumeNegativeTest-805605147 None] Deleting attachment ed69704c-82d2-46d8-a71b-e28cfde55be9. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:45:49 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:45:49 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:45:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "cinder-8c15fde4-e1ae-43f9-bf57-a717a4ebad68-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:45:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-8c15fde4-e1ae-43f9-bf57-a717a4ebad68-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:45:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:45:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "cinder-quobyte-8c15fde4-e1ae-43f9-bf57-a717a4ebad68" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:45:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-quobyte-8c15fde4-e1ae-43f9-bf57-a717a4ebad68" acquired by "delete_volume" :: waited 0.027s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:45:57 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfa821b-4124-4cb2-8c9a-832d9b7e2be2]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:45:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:45:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68" returned: 0 in 1.010s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:45:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:45:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-8c15fde4-e1ae-43f9-bf57-a717a4ebad68" returned: 0 in 0.289s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:45:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-quobyte-8c15fde4-e1ae-43f9-bf57-a717a4ebad68" released by "delete_volume" :: held 1.808s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:45:59 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Created reservations ['cc22f8ee-f932-45d6-ab9d-bf586d54baeb', '782b6731-0f8c-45d8-a942-ee0efe91f7ea', '99cb6289-4eac-4a8b-9e5e-a357539fabc2', 'f643afd9-0df4-47d6-b2a0-f0043ef9778b'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:46:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.041s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.851s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:01 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:46:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Deleted volume successfully. Sep 10 17:46:01 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:01 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:46:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Flow 'volume_create_manager' (d1cda228-6a55-4ba4-8174-458748d84e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e58fa54-a9b0-428e-ac1a-e6f15f62ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e58fa54-a9b0-428e-ac1a-e6f15f62ff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-545391278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f168c25f6042f1b79cc45068dd465a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:00Z,use_quota=True,user_id='a9c9622e8a5b42c1846ce4617889133a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad89659-5551-43a1-aa22-465708a65229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad89659-5551-43a1-aa22-465708a65229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23d0693-8292-4d2f-96a6-b2b5b127f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23d0693-8292-4d2f-96a6-b2b5b127f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d', 'volume_name': 'volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11fc8c3-7788-4ffe-9c29-9548b04f63b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11fc8c3-7788-4ffe-9c29-9548b04f63b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89355d8f-4b70-4273-9660-6bddc6859ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:02 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume 0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d', 'volume_size': 1} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-545391278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f168c25f6042f1b79cc45068dd465a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:00Z,use_quota=True,user_id='a9c9622e8a5b42c1846ce4617889133a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Creating volume 0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:46:02 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "cinder-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:02 devstack quobyte-client[82625]: System call of process 94110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:02 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=41, name=volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:46:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5d25462b-e865-459c-9e8c-a02594e0ce6b tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-8c15fde4-e1ae-43f9-bf57-a717a4ebad68-delete_volume" released by "delete_volume" :: held 6.274s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:03 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:03 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Flow 'volume_create_manager' (e23d6f8c-866d-439f-b15c-dc2ab0b6814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b5bfb2-8a0b-41e8-8f4f-5ee72d986e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7-delete_volume" acquired by "delete_volume" :: waited 1.755s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d 1073741824" returned: 0 in 1.995s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b5bfb2-8a0b-41e8-8f4f-5ee72d986e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1300877731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e460fe40-408e-4f95-92ab-024bfdb870fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f168c25f6042f1b79cc45068dd465a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:02Z,use_quota=True,user_id='a9c9622e8a5b42c1846ce4617889133a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8496d26b-9131-4bea-8be7-3f74b41821c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8496d26b-9131-4bea-8be7-3f74b41821c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5a7912-e964-4d8e-9bd4-119b4b8b74b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5a7912-e964-4d8e-9bd4-119b4b8b74b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e460fe40-408e-4f95-92ab-024bfdb870fa', 'volume_name': 'volume-e460fe40-408e-4f95-92ab-024bfdb870fa', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb95588-9a03-4463-999b-a3420d161255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb95588-9a03-4463-999b-a3420d161255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b1e1a0-cf87-4d38-97c0-a10a291efab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:05 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume e460fe40-408e-4f95-92ab-024bfdb870fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e460fe40-408e-4f95-92ab-024bfdb870fa', 'volume_size': 1} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d" returned: 0 in 0.908s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] <== create_volume: return (2932ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.943s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.256s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1300877731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e460fe40-408e-4f95-92ab-024bfdb870fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f168c25f6042f1b79cc45068dd465a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:02Z,use_quota=True,user_id='a9c9622e8a5b42c1846ce4617889133a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Creating volume e460fe40-408e-4f95-92ab-024bfdb870fa {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:46:05 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:46:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:05 devstack quobyte-client[82625]: System call of process 94115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:05 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=42, name=volume-e460fe40-408e-4f95-92ab-024bfdb870fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:46:06 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "cinder-quobyte-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:06 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89355d8f-4b70-4273-9660-6bddc6859ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:06 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e73183-2fa7-4d64-8ba1-3da3a54346c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa 1073741824" returned: 0 in 1.158s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-quobyte-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7" acquired by "delete_volume" :: waited 0.690s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:07 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d (0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d): created successfully Sep 10 17:46:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e73183-2fa7-4d64-8ba1-3da3a54346c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Flow 'volume_create_manager' (d1cda228-6a55-4ba4-8174-458748d84e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:07 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65b86a1-548d-438b-9b69-85483abf57c3]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:46:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:07 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7ced1f21-3653-4bc7-a7b8-f2af34503b1d tempest-TestServerVolumeAttachmentScenario-49585416 None] Created volume successfully. Sep 10 17:46:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa" returned: 0 in 1.657s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:08 devstack quobyte-client[82625]: System call of process 94119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] <== create_volume: return (3043ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:46:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.069s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7" returned: 0 in 1.176s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b1e1a0-cf87-4d38-97c0-a10a291efab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e460fe40-408e-4f95-92ab-024bfdb870fa', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd461fa0-9980-4c3d-8c06-ead23dc465c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7" returned: 0 in 0.797s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:09 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume volume-e460fe40-408e-4f95-92ab-024bfdb870fa (e460fe40-408e-4f95-92ab-024bfdb870fa): created successfully Sep 10 17:46:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd461fa0-9980-4c3d-8c06-ead23dc465c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Flow 'volume_create_manager' (e23d6f8c-866d-439f-b15c-dc2ab0b6814b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-quobyte-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7" released by "delete_volume" :: held 2.692s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:09 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-35432fd5-0b30-49cc-9ad2-ca92d339246c tempest-TestServerVolumeAttachmentScenario-49585416 None] Created volume successfully. Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Created reservations ['954c414f-1ebf-4cbb-a3e6-54a17e08e5d3', '22d0466c-7ff7-4766-b481-bde34eafe4b1', '29407a4b-5bae-4143-827b-3405ad62d604', '617ed4e5-5431-4773-a919-6169bd3ef79a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.270s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:10 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:46:11 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Deleted volume successfully. Sep 10 17:46:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "cinder-032688cb-1e19-4b02-9607-8a707b8b4223-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-032688cb-1e19-4b02-9607-8a707b8b4223-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-09e752a3-a9c5-4ac0-a7a7-7346f8b3e75c tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-2b8cc2db-8285-46b4-8f5d-ec413a1cf0b7-delete_volume" released by "delete_volume" :: held 7.455s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:12 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "cinder-quobyte-032688cb-1e19-4b02-9607-8a707b8b4223" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-quobyte-032688cb-1e19-4b02-9607-8a707b8b4223" acquired by "delete_volume" :: waited 0.044s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:12 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d548aa-cf64-4d52-8f5f-89a57c2b59d9]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:46:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223" returned: 0 in 1.143s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-032688cb-1e19-4b02-9607-8a707b8b4223" returned: 0 in 0.183s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-quobyte-032688cb-1e19-4b02-9607-8a707b8b4223" released by "delete_volume" :: held 1.633s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Created reservations ['d01977fc-b932-4a85-b95f-45123f16000f', '897fbf23-e71a-4abe-a46f-8e7544837019', 'c723842d-3bff-4187-aee4-8da19ec2b777', '73bffa1d-3182-47d0-8297-1a6e78a73401'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.108s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:14 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:46:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Deleted volume successfully. Sep 10 17:46:15 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-448c3e1b-563e-42c4-b853-886abac2181f tempest-AttachVolumeNegativeTest-805605147 None] Lock "cinder-032688cb-1e19-4b02-9607-8a707b8b4223-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:24 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=32,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:46:25 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.218s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:46:31 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Flow 'volume_create_manager' (3f5487a3-fcf9-4a54-985a-59c8710c7ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1715ecd1-a697-4329-a4ce-8f8eb5f515b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1715ecd1-a697-4329-a4ce-8f8eb5f515b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-915088517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a4438b-7453-43e5-aba3-4134eb869a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d219d2ac53b9436daef6aa1fa2cb0cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:31Z,use_quota=True,user_id='13bf0a48166e417ba4c7e3920ed49925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cd97ae-bf79-4a2d-9015-ab6d5f72e2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cd97ae-bf79-4a2d-9015-ab6d5f72e2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef12c1a0-a732-45a2-bcf2-4643afbce0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef12c1a0-a732-45a2-bcf2-4643afbce0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a4438b-7453-43e5-aba3-4134eb869a43', 'volume_name': 'volume-52a4438b-7453-43e5-aba3-4134eb869a43', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9d778d-afa5-4ba0-b262-852f81d078a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9d778d-afa5-4ba0-b262-852f81d078a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a51e284-cc5e-4927-b948-005a75598738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:31 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Volume 52a4438b-7453-43e5-aba3-4134eb869a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a4438b-7453-43e5-aba3-4134eb869a43', 'volume_size': 1} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-915088517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a4438b-7453-43e5-aba3-4134eb869a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d219d2ac53b9436daef6aa1fa2cb0cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:31Z,use_quota=True,user_id='13bf0a48166e417ba4c7e3920ed49925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Creating volume 52a4438b-7453-43e5-aba3-4134eb869a43 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:46:31 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:46:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:31 devstack quobyte-client[82625]: System call of process 94221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:31 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=43, name=volume-52a4438b-7453-43e5-aba3-4134eb869a43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 1073741824" returned: 0 in 0.443s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43" returned: 0 in 0.148s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] <== create_volume: return (744ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a51e284-cc5e-4927-b948-005a75598738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a4438b-7453-43e5-aba3-4134eb869a43', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb8d107-bc61-4731-8ca5-0880f050966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:32 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Volume volume-52a4438b-7453-43e5-aba3-4134eb869a43 (52a4438b-7453-43e5-aba3-4134eb869a43): created successfully Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb8d107-bc61-4731-8ca5-0880f050966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Flow 'volume_create_manager' (3f5487a3-fcf9-4a54-985a-59c8710c7ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-cc79f7e1-5397-4487-883d-547561cae2b0 req-10cb25e4-4b19-434b-a960-fd8a6d26e254 tempest-VolumesSnapshotsTestJSON-2143466988 None] Created volume successfully. Sep 10 17:46:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Creating offline snapshot 46b104a7-0a06-4059-bbde-bcf65af476cc of volume 52a4438b-7453-43e5-aba3-4134eb869a43 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:46:34 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b57cf0-f9c2-4cd0-83ca-8bbd1decd41e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:46:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:35 devstack quobyte-client[82625]: System call of process 94240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43" returned: 0 in 1.541s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:36 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=44, name=volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:46:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc 1G" returned: 0 in 0.821s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): qemu-img rebase -u -b volume-52a4438b-7453-43e5-aba3-4134eb869a43 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "qemu-img rebase -u -b volume-52a4438b-7453-43e5-aba3-4134eb869a43 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc" returned: 0 in 0.366s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:46:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc" returned: 0 in 0.173s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:46:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc" returned: 0 in 0.345s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.info" returned: 0 in 0.268s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:46:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.info" returned: 0 in 0.312s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.925s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-2d79cf50-c9cd-441c-9266-3e8c57959a2c req-0357ee7e-c22f-4d89-9d89-97c6fd34a396 tempest-VolumesSnapshotsTestJSON-2143466988 None] Create snapshot completed successfully Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "cinder-46b104a7-0a06-4059-bbde-bcf65af476cc-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-46b104a7-0a06-4059-bbde-bcf65af476cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "cinder-quobyte-52a4438b-7453-43e5-aba3-4134eb869a43" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-quobyte-52a4438b-7453-43e5-aba3-4134eb869a43" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "cinder-quobyte-46b104a7-0a06-4059-bbde-bcf65af476cc" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-quobyte-46b104a7-0a06-4059-bbde-bcf65af476cc" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Deleting offline snapshot 46b104a7-0a06-4059-bbde-bcf65af476cc of volume 52a4438b-7453-43e5-aba3-4134eb869a43 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] snapshot_file for this snap is: volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac7d185-06bb-4e85-b945-bfbe63185bad]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:46:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc" returned: 0 in 1.047s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52a4438b-7453-43e5-aba3-4134eb869a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:46:41 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545d72f-ea3d-4bce-a4ba-1fa9f10bda6c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:46:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43" returned: 0 in 0.489s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:42 devstack quobyte-client[82625]: System call of process 94355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc" returned: 0 in 0.541s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43.46b104a7-0a06-4059-bbde-bcf65af476cc" returned: 0 in 0.140s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-quobyte-46b104a7-0a06-4059-bbde-bcf65af476cc" released by "_delete_snapshot" :: held 2.801s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-quobyte-52a4438b-7453-43e5-aba3-4134eb869a43" released by "delete_snapshot" :: held 2.891s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:43 devstack cinder-volume[82609]: DEBUG cinder.quota [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Created reservations ['0cdbc7b4-1307-4524-8168-5bcd15d3617f', '2de0c5ac-5db6-4b3f-a879-f645ec4b90b5', '1d197fb5-5882-48e8-a870-55665e4bdf56', 'b4074a1f-49e0-4e77-aa95-f6740ddf5da3'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:46:44 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Delete snapshot completed successfully. Sep 10 17:46:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-5782c858-fc0c-4595-bcf8-2af7db5c9850 req-ec5a554c-fec9-4a49-a75c-936ebaa25bf5 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-46b104a7-0a06-4059-bbde-bcf65af476cc-delete_snapshot" released by "delete_snapshot" :: held 3.581s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "cinder-52a4438b-7453-43e5-aba3-4134eb869a43-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-52a4438b-7453-43e5-aba3-4134eb869a43-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "cinder-quobyte-52a4438b-7453-43e5-aba3-4134eb869a43" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:46:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-quobyte-52a4438b-7453-43e5-aba3-4134eb869a43" acquired by "delete_volume" :: waited 0.028s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:46:45 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[11939791-40b2-4573-b20a-4dc9e51c600b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:46:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:46 devstack quobyte-client[82625]: System call of process 94369 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43" returned: 0 in 0.738s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-52a4438b-7453-43e5-aba3-4134eb869a43" returned: 0 in 0.457s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-quobyte-52a4438b-7453-43e5-aba3-4134eb869a43" released by "delete_volume" :: held 1.825s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG cinder.quota [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Created reservations ['e3c28d89-2f87-4939-84d2-4ddf548d22e8', 'aa073a01-5db7-4044-baf7-e006d2c651f3', '254e5226-041c-4e0b-b055-a6eeed56d1e8', '19898091-013c-482a-a9ad-a6362193929f'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.116s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:48 devstack cinder-volume[82609]: DEBUG cinder.manager [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:46:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Deleted volume successfully. Sep 10 17:46:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-781aa546-17e8-444a-842c-06a99b1035e0 req-0b0efaad-3903-4c97-a517-0517397dfb19 tempest-VolumesSnapshotsTestJSON-2143466988 None] Lock "cinder-52a4438b-7453-43e5-aba3-4134eb869a43-delete_volume" released by "delete_volume" :: held 3.666s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:46:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Flow 'volume_create_manager' (43b809fc-96d2-4551-b846-ea21b8a6efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84747138-77ab-4787-bcfc-ddf052b8adc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84747138-77ab-4787-bcfc-ddf052b8adc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1844547637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c5fc63-ac7b-4b78-a9f1-ababc8200027,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40788b2f01de4d39aad172dd551763f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:54Z,use_quota=True,user_id='1df226c145874a9e8fe303d2b8bbf52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03dbe47-d5e5-491b-9d8b-f27ec4cd25e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03dbe47-d5e5-491b-9d8b-f27ec4cd25e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c93f55-8787-41fc-9556-affc90f9c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c93f55-8787-41fc-9556-affc90f9c723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c5fc63-ac7b-4b78-a9f1-ababc8200027', 'volume_name': 'volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062de2bf-141e-4d9e-aeb7-1e844616f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062de2bf-141e-4d9e-aeb7-1e844616f86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51950d3c-8360-4462-ad4d-47ba7a174da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:54 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Volume 03c5fc63-ac7b-4b78-a9f1-ababc8200027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027', 'volume_size': 1} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1844547637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c5fc63-ac7b-4b78-a9f1-ababc8200027,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40788b2f01de4d39aad172dd551763f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:54Z,use_quota=True,user_id='1df226c145874a9e8fe303d2b8bbf52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Creating volume 03c5fc63-ac7b-4b78-a9f1-ababc8200027 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:46:54 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:46:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:55 devstack quobyte-client[82625]: System call of process 94386 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:55 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=46, name=volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027 1073741824" returned: 0 in 0.448s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027" returned: 0 in 0.194s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] <== create_volume: return (706ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51950d3c-8360-4462-ad4d-47ba7a174da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd3dfee-34a8-44ff-8948-9cd32136a23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:55 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Volume volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027 (03c5fc63-ac7b-4b78-a9f1-ababc8200027): created successfully Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd3dfee-34a8-44ff-8948-9cd32136a23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Flow 'volume_create_manager' (43b809fc-96d2-4551-b846-ea21b8a6efce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:55 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f0228e40-69ac-41cc-ba40-09269799fd0d tempest-VolumesTestJSON-427149438 None] Created volume successfully. Sep 10 17:46:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Flow 'volume_create_manager' (6c90871e-7642-43be-90e6-ba073ad0a2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c018e127-75b6-43e0-8db8-03fd1e684016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c018e127-75b6-43e0-8db8-03fd1e684016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1723050417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4fe68e-6cf5-426a-b275-d54227680694,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40788b2f01de4d39aad172dd551763f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:57Z,use_quota=True,user_id='1df226c145874a9e8fe303d2b8bbf52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e793ecc4-7677-4b27-9bc6-cf39686dd910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e793ecc4-7677-4b27-9bc6-cf39686dd910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8de49cc-3589-4b8a-8c7c-e4e1eea7bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8de49cc-3589-4b8a-8c7c-e4e1eea7bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4fe68e-6cf5-426a-b275-d54227680694', 'volume_name': 'volume-ef4fe68e-6cf5-426a-b275-d54227680694', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f237e8-3ed7-4181-926d-d9867daa7b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f237e8-3ed7-4181-926d-d9867daa7b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98de4bef-90b3-43b8-bd59-b37427c27d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Volume ef4fe68e-6cf5-426a-b275-d54227680694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4fe68e-6cf5-426a-b275-d54227680694', 'volume_size': 1} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1723050417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4fe68e-6cf5-426a-b275-d54227680694,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40788b2f01de4d39aad172dd551763f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:57Z,use_quota=True,user_id='1df226c145874a9e8fe303d2b8bbf52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Creating volume ef4fe68e-6cf5-426a-b275-d54227680694 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:46:57 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:46:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ef4fe68e-6cf5-426a-b275-d54227680694 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:57 devstack quobyte-client[82625]: System call of process 94390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:46:57 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=47, name=volume-ef4fe68e-6cf5-426a-b275-d54227680694, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ef4fe68e-6cf5-426a-b275-d54227680694 1073741824" returned: 0 in 0.493s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ef4fe68e-6cf5-426a-b275-d54227680694 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ef4fe68e-6cf5-426a-b275-d54227680694" returned: 0 in 0.146s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] <== create_volume: return (765ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98de4bef-90b3-43b8-bd59-b37427c27d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4fe68e-6cf5-426a-b275-d54227680694', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bbfdc1-a2bd-42bb-98aa-18e7484ea434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:46:58 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Volume volume-ef4fe68e-6cf5-426a-b275-d54227680694 (ef4fe68e-6cf5-426a-b275-d54227680694): created successfully Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bbfdc1-a2bd-42bb-98aa-18e7484ea434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:46:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Flow 'volume_create_manager' (6c90871e-7642-43be-90e6-ba073ad0a2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:46:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-e794a593-e8ac-44d5-aa35-e21dd98caea1 tempest-VolumesTestJSON-427149438 None] Created volume successfully. Sep 10 17:47:00 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Flow 'volume_create_manager' (0cd1600a-18c0-40de-a7c1-c035b08ba93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f475056-84ed-49b1-9f6e-960a1088d918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f475056-84ed-49b1-9f6e-960a1088d918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-122374520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ab1fa9-c3e7-4355-b3ca-d62432d818fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40788b2f01de4d39aad172dd551763f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:00Z,use_quota=True,user_id='1df226c145874a9e8fe303d2b8bbf52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c701e782-cd2c-47b8-887f-95fbcf0379c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c701e782-cd2c-47b8-887f-95fbcf0379c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8263da-51a8-427d-b6df-54172b244ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8263da-51a8-427d-b6df-54172b244ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ab1fa9-c3e7-4355-b3ca-d62432d818fe', 'volume_name': 'volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dac5f8-64b5-4da3-b81d-b51b09efe90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dac5f8-64b5-4da3-b81d-b51b09efe90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80ca1d-bcf7-4351-b543-108c853fd620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:00 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Volume f7ab1fa9-c3e7-4355-b3ca-d62432d818fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe', 'volume_size': 1} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-122374520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ab1fa9-c3e7-4355-b3ca-d62432d818fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40788b2f01de4d39aad172dd551763f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:00Z,use_quota=True,user_id='1df226c145874a9e8fe303d2b8bbf52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Creating volume f7ab1fa9-c3e7-4355-b3ca-d62432d818fe {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:47:00 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:47:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:01 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=48, name=volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe 1073741824" returned: 0 in 0.502s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe" returned: 0 in 0.176s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] <== create_volume: return (761ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80ca1d-bcf7-4351-b543-108c853fd620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c1bc4a-0367-418c-a05d-2ca9390d7b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:01 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Volume volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe (f7ab1fa9-c3e7-4355-b3ca-d62432d818fe): created successfully Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c1bc4a-0367-418c-a05d-2ca9390d7b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Flow 'volume_create_manager' (0cd1600a-18c0-40de-a7c1-c035b08ba93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:47:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-de50ae08-5a61-4ae1-81a9-40a72e251f88 tempest-VolumesTestJSON-427149438 None] Created volume successfully. Sep 10 17:47:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Acquiring lock "cinder-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Lock "cinder-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Acquiring lock "cinder-quobyte-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Lock "cinder-quobyte-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe" acquired by "delete_volume" :: waited 0.022s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:04 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a1c627-a907-4d2e-9ccd-aacb8bda81b0]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:05 devstack quobyte-client[82625]: System call of process 94400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:47:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe" returned: 0 in 0.946s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe" returned: 0 in 0.143s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Lock "cinder-quobyte-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe" released by "delete_volume" :: held 1.330s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Created reservations ['641dc624-7fcc-4b05-aca8-a139adc959de', 'b724f08b-7a54-4b4a-81ef-5bb995e7eff8', '94a9e1e7-3008-4c37-8718-0668c9bf69df', '9adff694-f39d-4b9a-a464-b41bb1eae432'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.170s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:06 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:47:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Acquiring lock "cinder-ef4fe68e-6cf5-426a-b275-d54227680694-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:07 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Deleted volume successfully. Sep 10 17:47:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Lock "cinder-ef4fe68e-6cf5-426a-b275-d54227680694-delete_volume" acquired by "delete_volume" :: waited 0.438s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b8650edf-546b-4552-949c-fa209579a2ce tempest-VolumesTestJSON-427149438 None] Lock "cinder-f7ab1fa9-c3e7-4355-b3ca-d62432d818fe-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:08 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Acquiring lock "cinder-quobyte-ef4fe68e-6cf5-426a-b275-d54227680694" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Lock "cinder-quobyte-ef4fe68e-6cf5-426a-b275-d54227680694" acquired by "delete_volume" :: waited 0.131s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:08 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[31888bc8-9782-4b7b-941f-793db09fbbbb]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ef4fe68e-6cf5-426a-b275-d54227680694 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:10 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Flow 'volume_create_manager' (9444e0f5-9551-4018-9ab1-7fd04328485b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c02a265-d00b-477f-bb05-d362e84132d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c02a265-d00b-477f-bb05-d362e84132d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-472500939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01383c33-aaa6-4265-92af-79e6256eb888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013b67fa7b0a4008abac13c11a5b4cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:09Z,use_quota=True,user_id='25fc5c4c72144ed698eb08100b81a95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf66f369-0cb4-4866-b122-13dd435edb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf66f369-0cb4-4866-b122-13dd435edb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329fef64-3091-451f-9801-711295cbe35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329fef64-3091-451f-9801-711295cbe35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01383c33-aaa6-4265-92af-79e6256eb888', 'volume_name': 'volume-01383c33-aaa6-4265-92af-79e6256eb888', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285cec92-850b-4a13-b933-6a8247621e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285cec92-850b-4a13-b933-6a8247621e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789006a8-9e4a-4b48-8b6c-2ef2ae53d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:10 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Volume 01383c33-aaa6-4265-92af-79e6256eb888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01383c33-aaa6-4265-92af-79e6256eb888', 'volume_size': 1} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-472500939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01383c33-aaa6-4265-92af-79e6256eb888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013b67fa7b0a4008abac13c11a5b4cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:09Z,use_quota=True,user_id='25fc5c4c72144ed698eb08100b81a95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Creating volume 01383c33-aaa6-4265-92af-79e6256eb888 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:47:10 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:47:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:11 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=49, name=volume-01383c33-aaa6-4265-92af-79e6256eb888, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:47:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ef4fe68e-6cf5-426a-b275-d54227680694" returned: 0 in 2.720s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ef4fe68e-6cf5-426a-b275-d54227680694 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888 1073741824" returned: 0 in 1.051s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ef4fe68e-6cf5-426a-b275-d54227680694" returned: 0 in 0.481s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888" returned: 0 in 0.392s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] <== create_volume: return (1516ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Lock "cinder-quobyte-ef4fe68e-6cf5-426a-b275-d54227680694" released by "delete_volume" :: held 4.055s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789006a8-9e4a-4b48-8b6c-2ef2ae53d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01383c33-aaa6-4265-92af-79e6256eb888', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f12a55-b40f-41cf-89df-42fa90f91bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:12 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Volume volume-01383c33-aaa6-4265-92af-79e6256eb888 (01383c33-aaa6-4265-92af-79e6256eb888): created successfully Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f12a55-b40f-41cf-89df-42fa90f91bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Flow 'volume_create_manager' (9444e0f5-9551-4018-9ab1-7fd04328485b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:47:12 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Created reservations ['3b15e773-166a-4124-afe3-dc91943b4749', 'bd1c314e-f91b-4f09-b507-b9d55c8e850e', '36dd02d4-9c3e-43f9-946f-796bba4022e3', '7205a169-cce2-4027-9450-ff2313977987'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:47:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ea291ac8-40cd-4148-9dae-b31267e55fb8 tempest-AttachVolumeTestJSON-1826446911 None] Created volume successfully. Sep 10 17:47:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:13 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:13 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.229s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:13 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:47:13 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Deleted volume successfully. Sep 10 17:47:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Acquiring lock "cinder-03c5fc63-ac7b-4b78-a9f1-ababc8200027-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fac476f1-f479-4245-8bc6-4b7b9f8c34b4 tempest-VolumesTestJSON-427149438 None] Lock "cinder-ef4fe68e-6cf5-426a-b275-d54227680694-delete_volume" released by "delete_volume" :: held 6.765s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Lock "cinder-03c5fc63-ac7b-4b78-a9f1-ababc8200027-delete_volume" acquired by "delete_volume" :: waited 0.253s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:14 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Acquiring lock "cinder-quobyte-03c5fc63-ac7b-4b78-a9f1-ababc8200027" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Lock "cinder-quobyte-03c5fc63-ac7b-4b78-a9f1-ababc8200027" acquired by "delete_volume" :: waited 0.026s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:14 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[9825b54b-b4cf-4b0a-af8c-1856ae6cd00c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:15 devstack quobyte-client[82625]: System call of process 94436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:47:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027" returned: 0 in 0.861s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03c5fc63-ac7b-4b78-a9f1-ababc8200027" returned: 0 in 0.181s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:15 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Lock "cinder-quobyte-03c5fc63-ac7b-4b78-a9f1-ababc8200027" released by "delete_volume" :: held 1.311s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Created reservations ['f469a8b7-ee68-49b0-803d-faaab3407a3a', '4cf96153-6e40-467c-9833-56f9059ca717', 'dc3539f6-4edf-4008-8cdf-4a910ba1ee12', 'ab1bb751-4820-4686-8ee0-16440d7b5cd0'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.128s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:16 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:47:16 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Deleted volume successfully. Sep 10 17:47:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc9d2769-a52d-4e49-8ac9-3ddfd6b3a2b8 tempest-VolumesTestJSON-427149438 None] Lock "cinder-03c5fc63-ac7b-4b78-a9f1-ababc8200027-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-74062222-1862-4d67-bca3-2d88869ea977 req-c2c91525-9fb8-4c13-bdc9-8ef1a37b02ed tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-74062222-1862-4d67-bca3-2d88869ea977 req-c2c91525-9fb8-4c13-bdc9-8ef1a37b02ed tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:19 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[930217d1-c4fc-4d73-a065-11ca1e58d60d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-74062222-1862-4d67-bca3-2d88869ea977 req-c2c91525-9fb8-4c13-bdc9-8ef1a37b02ed tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-74062222-1862-4d67-bca3-2d88869ea977 req-c2c91525-9fb8-4c13-bdc9-8ef1a37b02ed tempest-AttachVolumeTestJSON-1826446911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888" returned: 0 in 0.602s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-74062222-1862-4d67-bca3-2d88869ea977 req-c2c91525-9fb8-4c13-bdc9-8ef1a37b02ed tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.669s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-74062222-1862-4d67-bca3-2d88869ea977 req-c2c91525-9fb8-4c13-bdc9-8ef1a37b02ed tempest-AttachVolumeTestJSON-1826446911 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-01383c33-aaa6-4265-92af-79e6256eb888', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '844679af-44fa-4905-87d9-f479b877b9a9', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:47:20 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-74062222-1862-4d67-bca3-2d88869ea977 req-c2c91525-9fb8-4c13-bdc9-8ef1a37b02ed tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:20 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-74062222-1862-4d67-bca3-2d88869ea977 req-c2c91525-9fb8-4c13-bdc9-8ef1a37b02ed tempest-AttachVolumeTestJSON-1826446911 None] attachment_update completed successfully. Sep 10 17:47:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-96271993-a2cd-434b-8af0-16dd19f55afc tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-96271993-a2cd-434b-8af0-16dd19f55afc tempest-GroupSnapshotsTest-1915941677 None] Group tempest-GroupSnapshotsTest-Group-1165578490: creating Sep 10 17:47:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-96271993-a2cd-434b-8af0-16dd19f55afc tempest-GroupSnapshotsTest-1915941677 None] Group tempest-GroupSnapshotsTest-Group-1165578490: created successfully Sep 10 17:47:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-96271993-a2cd-434b-8af0-16dd19f55afc tempest-GroupSnapshotsTest-1915941677 None] Create group completed successfully. Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=49,cinder:DELETE=6,cinder:SELECT=33,cinder:INSERT=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=45,cinder:UPDATE=55,cinder:INSERT=18,cinder:DELETE=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:47:26 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Flow 'volume_create_manager' (91fd09a1-2b92-4b4a-b762-61bb4ce289f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340dcffc-136e-4a42-a43c-02db186ba57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340dcffc-136e-4a42-a43c-02db186ba57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951513220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91c0014b-3ac1-445c-862a-a7465e7bb5b0,host='devstack@QuobyteHD#QuobyteHD',id=515b0ce3-f87b-47e9-86c7-1a02ae0b25d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d85a40748147768e046a3422a95876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:26Z,use_quota=True,user_id='500f1e6fc4b64cef82b4b6469c1a4d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c808cc2d-2001-42b7-9b0a-ad0184206c6b),volume_type_id=c808cc2d-2001-42b7-9b0a-ad0184206c6b)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f549900-ad7d-479e-a2e9-4e071539f284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f549900-ad7d-479e-a2e9-4e071539f284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1dc837-bfcc-4d85-941c-8f409ca44856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1dc837-bfcc-4d85-941c-8f409ca44856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515b0ce3-f87b-47e9-86c7-1a02ae0b25d2', 'volume_name': 'volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2150a008-de30-49be-87ab-f151e492b3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2150a008-de30-49be-87ab-f151e492b3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d7be93-baca-4eae-be2f-5e04f6224886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:26 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Volume 515b0ce3-f87b-47e9-86c7-1a02ae0b25d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2', 'volume_size': 1} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91c0014b-3ac1-445c-862a-a7465e7bb5b0,created_at=2025-09-10T15:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951513220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91c0014b-3ac1-445c-862a-a7465e7bb5b0,host='devstack@QuobyteHD#QuobyteHD',id=515b0ce3-f87b-47e9-86c7-1a02ae0b25d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d85a40748147768e046a3422a95876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:26Z,use_quota=True,user_id='500f1e6fc4b64cef82b4b6469c1a4d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c808cc2d-2001-42b7-9b0a-ad0184206c6b),volume_type_id=c808cc2d-2001-42b7-9b0a-ad0184206c6b)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Creating volume 515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:47:26 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:47:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:26 devstack quobyte-client[82625]: System call of process 94880 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:47:26 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=50, name=volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 1073741824" returned: 0 in 0.460s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" returned: 0 in 0.319s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] <== create_volume: return (840ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.388s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d7be93-baca-4eae-be2f-5e04f6224886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c04657-a44d-405d-ae38-d49f070fe901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:27 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Volume volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 (515b0ce3-f87b-47e9-86c7-1a02ae0b25d2): created successfully Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c04657-a44d-405d-ae38-d49f070fe901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Flow 'volume_create_manager' (91fd09a1-2b92-4b4a-b762-61bb4ce289f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:47:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d4feef44-7393-4109-83b9-6b4ef8bcf0ee tempest-GroupSnapshotsTest-1915941677 None] Created volume successfully. Sep 10 17:47:29 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Flow 'volume_create_manager' (0335d7ce-f2ee-41d4-93c3-2831d9e96f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d671d5b3-58f4-4d51-94a6-aeb87e911703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d671d5b3-58f4-4d51-94a6-aeb87e911703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1477372742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4c00c1-2935-4339-ac2f-7eb829be4576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013b67fa7b0a4008abac13c11a5b4cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:29Z,use_quota=True,user_id='25fc5c4c72144ed698eb08100b81a95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fc8d70-2ab4-451c-b753-165d9b3fa621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fc8d70-2ab4-451c-b753-165d9b3fa621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9161ba23-0ec7-423a-be60-871743980fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9161ba23-0ec7-423a-be60-871743980fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4c00c1-2935-4339-ac2f-7eb829be4576', 'volume_name': 'volume-4d4c00c1-2935-4339-ac2f-7eb829be4576', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49f8b60-944b-4bc6-b9c9-48d88141b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49f8b60-944b-4bc6-b9c9-48d88141b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2ba3a2-683c-419a-968f-c9d355abdcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:29 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Volume 4d4c00c1-2935-4339-ac2f-7eb829be4576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4c00c1-2935-4339-ac2f-7eb829be4576', 'volume_size': 1} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1477372742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4c00c1-2935-4339-ac2f-7eb829be4576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013b67fa7b0a4008abac13c11a5b4cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:29Z,use_quota=True,user_id='25fc5c4c72144ed698eb08100b81a95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Creating volume 4d4c00c1-2935-4339-ac2f-7eb829be4576 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:47:29 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:29 devstack quobyte-client[82625]: System call of process 94885 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:47:29 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=51, name=volume-4d4c00c1-2935-4339-ac2f-7eb829be4576, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576 1073741824" returned: 0 in 0.449s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:30 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] GroupSnapshot f0614eab-69d3-42f7-ab25-d2a12153672a: creating. Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576" returned: 0 in 0.431s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] <== create_volume: return (951ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:30 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Group snapshot f0614eab-69d3-42f7-ab25-d2a12153672a: creating. {{(pid=82609) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2ba3a2-683c-419a-968f-c9d355abdcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4c00c1-2935-4339-ac2f-7eb829be4576', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951fbea2-7dce-4389-a379-8d737810f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Creating offline snapshot 31763563-40d6-43e3-a2a6-c90e33b333f8 of volume 515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:47:30 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Volume volume-4d4c00c1-2935-4339-ac2f-7eb829be4576 (4d4c00c1-2935-4339-ac2f-7eb829be4576): created successfully Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951fbea2-7dce-4389-a379-8d737810f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Flow 'volume_create_manager' (0335d7ce-f2ee-41d4-93c3-2831d9e96f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c423356-eb83-4dba-b7d3-d33ddd8bac5e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:30 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7f23fd19-140d-424d-84b4-eca9bd9e7577 tempest-AttachVolumeTestJSON-1826446911 None] Created volume successfully. Sep 10 17:47:31 devstack quobyte-client[82625]: System call of process 94889 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" returned: 0 in 0.657s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:31 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=52, name=volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 1G" returned: 0 in 0.262s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img rebase -u -b volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img rebase -u -b volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8" returned: 0 in 0.140s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8" returned: 0 in 0.109s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8" returned: 0 in 0.086s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.info" returned: 0 in 0.112s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:47:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.info" returned: 0 in 0.088s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-425c8366-3889-4664-9177-65f70606541a tempest-GroupSnapshotsTest-1915941677 None] group_snapshot f0614eab-69d3-42f7-ab25-d2a12153672a: created successfully Sep 10 17:47:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-31763563-40d6-43e3-a2a6-c90e33b333f8-b2d671c8-966f-411e-b6fa-06ce73874ee8" by "_create_volume_from_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-31763563-40d6-43e3-a2a6-c90e33b333f8-b2d671c8-966f-411e-b6fa-06ce73874ee8" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Creating volume b2d671c8-966f-411e-b6fa-06ce73874ee8 from snapshot 31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-b2d671c8-966f-411e-b6fa-06ce73874ee8" by "_copy_volume_from_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-b2d671c8-966f-411e-b6fa-06ce73874ee8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] snapshot: 31763563-40d6-43e3-a2a6-c90e33b333f8, volume: b2d671c8-966f-411e-b6fa-06ce73874ee8, {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a2dae-7b2a-4401-ac6a-861ef4998dc8]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8" returned: 0 in 0.763s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:47:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 17:47:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Creating direct copy from snapshot {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 17:47:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-4127a44c-70b1-4d50-8355-8752cd76e4bd req-802bf8b7-18cc-412d-a975-dfcbbdcede79 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:35 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e9654f-1a5e-471f-b78f-c6139c3a1cfe]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" returned: 0 in 0.474s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:36 devstack cinder-volume[82609]: DEBUG cinder.utils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8 not found in is_blk_device check {{(pid=82609) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 17:47:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:36 devstack quobyte-client[82625]: System call of process 94917 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:47:36 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=54, name=volume-b2d671c8-966f-411e-b6fa-06ce73874ee8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:47:45 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:47:45 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=4,cinder:SELECT=13,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:47:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8" returned: 0 in 9.507s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:45 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d013964-f5a6-44e2-b4dd-a35aed34bcb1]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" returned: 0 in 0.692s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2, size 1024.00 MB, duration 9.52 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:47:46 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Converted 1024.00 MB image at 107.61 MB/s Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8" returned: 0 in 0.103s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-b2d671c8-966f-411e-b6fa-06ce73874ee8" released by "_copy_volume_from_snapshot" :: held 11.845s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-31763563-40d6-43e3-a2a6-c90e33b333f8-b2d671c8-966f-411e-b6fa-06ce73874ee8" released by "_create_volume_from_snapshot" :: held 11.891s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.954s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-4127a44c-70b1-4d50-8355-8752cd76e4bd req-802bf8b7-18cc-412d-a975-dfcbbdcede79 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.112s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d4e9cd-dfa9-4c5a-8408-533486956514]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-4127a44c-70b1-4d50-8355-8752cd76e4bd req-802bf8b7-18cc-412d-a975-dfcbbdcede79 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:47 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f8899e8c-edc9-4e70-b72f-abe870127a29 tempest-GroupSnapshotsTest-1915941677 None] Create group from source-snapshot-f0614eab-69d3-42f7-ab25-d2a12153672a completed successfully. Sep 10 17:47:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-4127a44c-70b1-4d50-8355-8752cd76e4bd req-802bf8b7-18cc-412d-a975-dfcbbdcede79 tempest-AttachVolumeTestJSON-1826446911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576" returned: 0 in 0.749s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-4127a44c-70b1-4d50-8355-8752cd76e4bd req-802bf8b7-18cc-412d-a975-dfcbbdcede79 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.804s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-4127a44c-70b1-4d50-8355-8752cd76e4bd req-802bf8b7-18cc-412d-a975-dfcbbdcede79 tempest-AttachVolumeTestJSON-1826446911 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-4d4c00c1-2935-4339-ac2f-7eb829be4576', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afbb0ac6-39ab-4545-8c2a-914597234ce7', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:47:47 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-4127a44c-70b1-4d50-8355-8752cd76e4bd req-802bf8b7-18cc-412d-a975-dfcbbdcede79 tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:47 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-4127a44c-70b1-4d50-8355-8752cd76e4bd req-802bf8b7-18cc-412d-a975-dfcbbdcede79 tempest-AttachVolumeTestJSON-1826446911 None] attachment_update completed successfully. Sep 10 17:47:48 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-b2d671c8-966f-411e-b6fa-06ce73874ee8" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-b2d671c8-966f-411e-b6fa-06ce73874ee8" acquired by "delete_volume" :: waited 0.068s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:48 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[8164a7d6-b914-42ee-b99f-06de872d22bc]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8" returned: 0 in 0.590s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b2d671c8-966f-411e-b6fa-06ce73874ee8" returned: 0 in 0.149s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-b2d671c8-966f-411e-b6fa-06ce73874ee8" released by "delete_volume" :: held 0.967s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['2b5bc806-54b1-4fb4-bb2d-c130fab90f0a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:47:50 devstack cinder-volume[82609]: WARNING cinder.quota [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-521368497 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-521368497, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:47:50 devstack cinder-volume[82609]: WARNING cinder.quota [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-521368497 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-521368497, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['87587b8e-c754-44da-aff6-108106746c4c', 'e2ed1b5f-b0b3-427b-a9de-965f2d0377cb', '81648a30-c7aa-4534-8da8-d671afe6d621', 'd1736bc7-5a99-45cc-ac61-036c45f2db4d'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.097s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:50 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:47:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-566285c8-23f6-46b0-8261-c6e83d0a05f6 tempest-GroupSnapshotsTest-1915941677 None] Delete group completed successfully. Sep 10 17:47:51 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] group_snapshot f0614eab-69d3-42f7-ab25-d2a12153672a: deleting Sep 10 17:47:51 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] group_snapshot f0614eab-69d3-42f7-ab25-d2a12153672a: deleting {{(pid=82609) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-31763563-40d6-43e3-a2a6-c90e33b333f8" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-31763563-40d6-43e3-a2a6-c90e33b333f8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Deleting offline snapshot 31763563-40d6-43e3-a2a6-c90e33b333f8 of volume 515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] snapshot_file for this snap is: volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35f80e7-b0c0-488a-9a36-202ea78c058c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8" returned: 0 in 0.470s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:47:51 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0c9c8a-84ec-44fd-87b6-89ff2d454ebd]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" returned: 0 in 0.474s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:52 devstack quobyte-client[82625]: System call of process 95044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:47:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8" returned: 0 in 0.341s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2.31763563-40d6-43e3-a2a6-c90e33b333f8" returned: 0 in 0.105s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-31763563-40d6-43e3-a2a6-c90e33b333f8" released by "_delete_snapshot" :: held 1.728s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" released by "delete_snapshot" :: held 1.753s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:53 devstack cinder-volume[82609]: WARNING cinder.quota [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-521368497 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-521368497, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:47:53 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['121827c7-0158-44b1-b426-879c399875ad', 'f7c3b375-b8f5-4a2e-ac9b-96e811e87f4e', 'f8bb38e0-593c-4f3e-a3cf-eb75b2b13f70', 'fb7dd3c3-2df6-46bc-a720-7d1201946b18'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:47:53 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-507aa68c-b485-4631-b319-04df9f8ae911 tempest-GroupSnapshotsTest-1915941677 None] group_snapshot f0614eab-69d3-42f7-ab25-d2a12153672a: deleted successfully Sep 10 17:47:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:47:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:47:54 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[956d68bc-50ac-4184-93d1-42cf48108628]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:47:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" returned: 0 in 0.462s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" returned: 0 in 0.157s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-515b0ce3-f87b-47e9-86c7-1a02ae0b25d2" released by "delete_volume" :: held 0.834s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['2c5eb38b-e7a0-4148-850c-ff5764d86a1b'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:47:56 devstack cinder-volume[82609]: WARNING cinder.db.sqlalchemy.api [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-521368497'] Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['6509ac43-75ce-47c8-aae8-bcdb59a84118', '311689a2-939b-462b-af0e-d08a5eb255e6', '2f7bc018-9178-4f3a-ad4c-4aa5aca67e3e', 'f5d800d0-fb00-4fc9-91ac-005523e6dc04'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.159s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:47:56 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:47:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-dbb18482-ed2f-4aff-a0e7-5e1c87bd7fd5 tempest-GroupSnapshotsTest-1915941677 None] Delete group completed successfully. Sep 10 17:47:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c1a83c1e-4c1c-4885-86ac-acc4c7a7e387 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:47:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c1a83c1e-4c1c-4885-86ac-acc4c7a7e387 tempest-GroupSnapshotsTest-1915941677 None] Group tempest-GroupSnapshotsTest-Group-138781566: creating Sep 10 17:47:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c1a83c1e-4c1c-4885-86ac-acc4c7a7e387 tempest-GroupSnapshotsTest-1915941677 None] Group tempest-GroupSnapshotsTest-Group-138781566: created successfully Sep 10 17:47:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c1a83c1e-4c1c-4885-86ac-acc4c7a7e387 tempest-GroupSnapshotsTest-1915941677 None] Create group completed successfully. Sep 10 17:48:00 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Flow 'volume_create_manager' (d461e6c7-2cb0-4aca-9354-df1107a7441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf2dfe3-5d9c-4fa7-82c8-974e5e156e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf2dfe3-5d9c-4fa7-82c8-974e5e156e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1464451065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=572acb28-a1c3-4c6c-9b07-442ba86b7e6d,host='devstack@QuobyteHD#QuobyteHD',id=ec84ed26-00ca-4d8e-b623-39b7ec92273d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d85a40748147768e046a3422a95876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:00Z,use_quota=True,user_id='500f1e6fc4b64cef82b4b6469c1a4d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4c08695-fec2-44f9-8ed9-01da6e207d9a),volume_type_id=d4c08695-fec2-44f9-8ed9-01da6e207d9a)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0e10ff-c7f4-4b73-b681-2bf9a0d66e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0e10ff-c7f4-4b73-b681-2bf9a0d66e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ef91ee-5ccd-4b1a-8267-9d56ad6bc769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ef91ee-5ccd-4b1a-8267-9d56ad6bc769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec84ed26-00ca-4d8e-b623-39b7ec92273d', 'volume_name': 'volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01f4261-0b5a-46ee-86ae-0518c0eee159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01f4261-0b5a-46ee-86ae-0518c0eee159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2036b4-67b1-4401-990d-2a1bf5178638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:00 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Volume ec84ed26-00ca-4d8e-b623-39b7ec92273d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d', 'volume_size': 1} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=572acb28-a1c3-4c6c-9b07-442ba86b7e6d,created_at=2025-09-10T15:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1464451065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=572acb28-a1c3-4c6c-9b07-442ba86b7e6d,host='devstack@QuobyteHD#QuobyteHD',id=ec84ed26-00ca-4d8e-b623-39b7ec92273d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d85a40748147768e046a3422a95876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:00Z,use_quota=True,user_id='500f1e6fc4b64cef82b4b6469c1a4d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4c08695-fec2-44f9-8ed9-01da6e207d9a),volume_type_id=d4c08695-fec2-44f9-8ed9-01da6e207d9a)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Creating volume ec84ed26-00ca-4d8e-b623-39b7ec92273d {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:48:00 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:48:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:00 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=55, name=volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d 1073741824" returned: 0 in 0.460s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d" returned: 0 in 0.125s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] <== create_volume: return (665ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2036b4-67b1-4401-990d-2a1bf5178638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55de8711-4b14-45c6-8dcd-55ab1200c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:01 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Volume volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d (ec84ed26-00ca-4d8e-b623-39b7ec92273d): created successfully Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55de8711-4b14-45c6-8dcd-55ab1200c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Flow 'volume_create_manager' (d461e6c7-2cb0-4aca-9354-df1107a7441a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:48:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f0f05914-cdf2-4b07-b14d-47e2e019553a tempest-GroupSnapshotsTest-1915941677 None] Created volume successfully. Sep 10 17:48:03 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Flow 'volume_create_manager' (b9f1a8ef-9b52-4cba-98d0-c758703cd5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f276211e-9556-4627-a867-e421911987e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f276211e-9556-4627-a867-e421911987e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47122087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=572acb28-a1c3-4c6c-9b07-442ba86b7e6d,host='devstack@QuobyteHD#QuobyteHD',id=11e24803-5ae6-4cde-8533-c64846a4d569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d85a40748147768e046a3422a95876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:03Z,use_quota=True,user_id='500f1e6fc4b64cef82b4b6469c1a4d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4c08695-fec2-44f9-8ed9-01da6e207d9a),volume_type_id=d4c08695-fec2-44f9-8ed9-01da6e207d9a)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22335f2c-1d82-49db-b0c6-ba0faed24ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22335f2c-1d82-49db-b0c6-ba0faed24ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27a0541-2243-4270-b207-17d27bcd690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27a0541-2243-4270-b207-17d27bcd690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e24803-5ae6-4cde-8533-c64846a4d569', 'volume_name': 'volume-11e24803-5ae6-4cde-8533-c64846a4d569', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab33714-f95b-420f-b82a-0a8a1c118264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab33714-f95b-420f-b82a-0a8a1c118264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba447b6-5361-42cd-aa1c-0df037363cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:03 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Volume 11e24803-5ae6-4cde-8533-c64846a4d569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e24803-5ae6-4cde-8533-c64846a4d569', 'volume_size': 1} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=572acb28-a1c3-4c6c-9b07-442ba86b7e6d,created_at=2025-09-10T15:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47122087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=572acb28-a1c3-4c6c-9b07-442ba86b7e6d,host='devstack@QuobyteHD#QuobyteHD',id=11e24803-5ae6-4cde-8533-c64846a4d569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d85a40748147768e046a3422a95876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:03Z,use_quota=True,user_id='500f1e6fc4b64cef82b4b6469c1a4d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4c08695-fec2-44f9-8ed9-01da6e207d9a),volume_type_id=d4c08695-fec2-44f9-8ed9-01da6e207d9a)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Creating volume 11e24803-5ae6-4cde-8533-c64846a4d569 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:48:03 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:03 devstack quobyte-client[82625]: System call of process 95086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:48:03 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=56, name=volume-11e24803-5ae6-4cde-8533-c64846a4d569, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 1073741824" returned: 0 in 0.586s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569" returned: 0 in 0.300s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] <== create_volume: return (968ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba447b6-5361-42cd-aa1c-0df037363cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e24803-5ae6-4cde-8533-c64846a4d569', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984022a6-26e9-429e-9c23-6ca47580161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:04 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Volume volume-11e24803-5ae6-4cde-8533-c64846a4d569 (11e24803-5ae6-4cde-8533-c64846a4d569): created successfully Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984022a6-26e9-429e-9c23-6ca47580161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Flow 'volume_create_manager' (b9f1a8ef-9b52-4cba-98d0-c758703cd5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:48:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4c816956-64e0-4497-b1ea-3020f2f85e9f tempest-GroupSnapshotsTest-1915941677 None] Created volume successfully. Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-84571716-4af8-4c6e-847b-91582d94193e req-f111db82-c257-4469-a710-d4a12195b587 tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-84571716-4af8-4c6e-847b-91582d94193e req-f111db82-c257-4469-a710-d4a12195b587 tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2b3727-d8dd-427a-a978-3c500ddef8bf]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-84571716-4af8-4c6e-847b-91582d94193e req-f111db82-c257-4469-a710-d4a12195b587 tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-84571716-4af8-4c6e-847b-91582d94193e req-f111db82-c257-4469-a710-d4a12195b587 tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d" returned: 0 in 0.416s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-84571716-4af8-4c6e-847b-91582d94193e req-f111db82-c257-4469-a710-d4a12195b587 tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.487s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-84571716-4af8-4c6e-847b-91582d94193e req-f111db82-c257-4469-a710-d4a12195b587 tempest-TestServerVolumeAttachmentScenario-49585416 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8757007-26f7-445d-b058-0043aab8534c', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:48:05 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-84571716-4af8-4c6e-847b-91582d94193e req-f111db82-c257-4469-a710-d4a12195b587 tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:05 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-894db653-3aad-432b-a954-d4528bc725b8 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:05 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-84571716-4af8-4c6e-847b-91582d94193e req-f111db82-c257-4469-a710-d4a12195b587 tempest-TestServerVolumeAttachmentScenario-49585416 None] attachment_update completed successfully. Sep 10 17:48:05 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-894db653-3aad-432b-a954-d4528bc725b8 tempest-GroupSnapshotsTest-1915941677 None] Update group completed successfully. Sep 10 17:48:06 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-dc9913f2-95ef-4ed6-8358-e4b79dc829fc tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:07 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-dc9913f2-95ef-4ed6-8358-e4b79dc829fc tempest-GroupSnapshotsTest-1915941677 None] Update group completed successfully. Sep 10 17:48:08 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1c4c696d-816c-4da7-8acf-67c95d09ef9a tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:08 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1c4c696d-816c-4da7-8acf-67c95d09ef9a tempest-GroupSnapshotsTest-1915941677 None] Update group completed successfully. Sep 10 17:48:09 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-fa6e02b6-9bab-49f3-b6ac-6e461518e19c tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:09 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-fa6e02b6-9bab-49f3-b6ac-6e461518e19c tempest-GroupSnapshotsTest-1915941677 None] Update group completed successfully. Sep 10 17:48:11 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] GroupSnapshot ed4dcaf1-6e3e-4854-9fd9-66eeb1e4a748: creating. Sep 10 17:48:11 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Group snapshot ed4dcaf1-6e3e-4854-9fd9-66eeb1e4a748: creating. {{(pid=82609) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 17:48:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Creating offline snapshot 27142b2c-654f-45c1-9a59-caf0672a6d69 of volume ec84ed26-00ca-4d8e-b623-39b7ec92273d {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:48:11 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[7422e529-3681-4564-92b0-e22d8c43e584]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d" returned: 0 in 0.644s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:12 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=57, name=volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 1G" returned: 0 in 0.273s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img rebase -u -b volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69" returned: 0 in 0.197s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69" returned: 0 in 0.093s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69" returned: 0 in 0.104s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.info" returned: 0 in 0.112s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:48:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.info" returned: 0 in 0.117s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:13 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Creating offline snapshot 7ca4796b-2581-4e45-ae04-349d035567c3 of volume 11e24803-5ae6-4cde-8533-c64846a4d569 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:48:13 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba16e81-f420-4aa7-bd9f-ce6a73c12494]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569" returned: 0 in 0.510s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:14 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=59, name=volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 1G" returned: 0 in 0.280s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img rebase -u -b volume-11e24803-5ae6-4cde-8533-c64846a4d569 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img rebase -u -b volume-11e24803-5ae6-4cde-8533-c64846a4d569 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3" returned: 0 in 0.157s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3" returned: 0 in 0.125s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3" returned: 0 in 0.112s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.info" returned: 0 in 0.131s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:48:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.info" returned: 0 in 0.100s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2239a043-e9ac-45d8-97fa-a541a478c400 tempest-GroupSnapshotsTest-1915941677 None] group_snapshot ed4dcaf1-6e3e-4854-9fd9-66eeb1e4a748: created successfully Sep 10 17:48:16 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] group_snapshot ed4dcaf1-6e3e-4854-9fd9-66eeb1e4a748: deleting Sep 10 17:48:16 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] group_snapshot ed4dcaf1-6e3e-4854-9fd9-66eeb1e4a748: deleting {{(pid=82609) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-ec84ed26-00ca-4d8e-b623-39b7ec92273d" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-ec84ed26-00ca-4d8e-b623-39b7ec92273d" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-27142b2c-654f-45c1-9a59-caf0672a6d69" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-27142b2c-654f-45c1-9a59-caf0672a6d69" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Deleting offline snapshot 27142b2c-654f-45c1-9a59-caf0672a6d69 of volume ec84ed26-00ca-4d8e-b623-39b7ec92273d {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] snapshot_file for this snap is: volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f5b1e8-724a-4efe-a5fd-099d8e0fd454]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:17 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-dce6a8b7-bfa5-4bf8-8f1f-8cc198a49ea6 req-515b4e3b-8c5f-4cb2-b51d-08b41d602851 tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:17 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-dce6a8b7-bfa5-4bf8-8f1f-8cc198a49ea6 req-515b4e3b-8c5f-4cb2-b51d-08b41d602851 tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:17 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-dce6a8b7-bfa5-4bf8-8f1f-8cc198a49ea6 req-515b4e3b-8c5f-4cb2-b51d-08b41d602851 tempest-AttachVolumeTestJSON-1826446911 None] Terminate volume connection completed successfully. Sep 10 17:48:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-dce6a8b7-bfa5-4bf8-8f1f-8cc198a49ea6 req-515b4e3b-8c5f-4cb2-b51d-08b41d602851 tempest-AttachVolumeTestJSON-1826446911 None] Deleting attachment 844679af-44fa-4905-87d9-f479b877b9a9. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:48:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69" returned: 0 in 0.580s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:48:17 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[4531e31c-a89c-40cd-b9f7-634bd0724a4d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d" returned: 0 in 0.454s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:18 devstack quobyte-client[82625]: System call of process 95160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69" returned: 0 in 0.364s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d.27142b2c-654f-45c1-9a59-caf0672a6d69" returned: 0 in 0.115s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-27142b2c-654f-45c1-9a59-caf0672a6d69" released by "_delete_snapshot" :: held 1.841s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-ec84ed26-00ca-4d8e-b623-39b7ec92273d" released by "delete_snapshot" :: held 1.882s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-11e24803-5ae6-4cde-8533-c64846a4d569" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-11e24803-5ae6-4cde-8533-c64846a4d569" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-7ca4796b-2581-4e45-ae04-349d035567c3" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-7ca4796b-2581-4e45-ae04-349d035567c3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Deleting offline snapshot 7ca4796b-2581-4e45-ae04-349d035567c3 of volume 11e24803-5ae6-4cde-8533-c64846a4d569 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] snapshot_file for this snap is: volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[6690ca62-a6e0-405f-a070-6ca6ad13143d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:19 devstack quobyte-client[82625]: System call of process 95164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:48:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3" returned: 0 in 0.525s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11e24803-5ae6-4cde-8533-c64846a4d569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:48:19 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b0c10e-7231-472a-97e2-5df02e191da5]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569" returned: 0 in 0.642s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-d4d532ec-d58d-4509-ab2e-a4c5e6fbc991 req-71fd0078-6e54-463b-8414-185e9ff370e0 tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-d4d532ec-d58d-4509-ab2e-a4c5e6fbc991 req-71fd0078-6e54-463b-8414-185e9ff370e0 tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3" returned: 0 in 0.458s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:20 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84ccce-b096-4602-aed8-cc2d8d682167]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-d4d532ec-d58d-4509-ab2e-a4c5e6fbc991 req-71fd0078-6e54-463b-8414-185e9ff370e0 tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569.7ca4796b-2581-4e45-ae04-349d035567c3" returned: 0 in 0.316s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-7ca4796b-2581-4e45-ae04-349d035567c3" released by "_delete_snapshot" :: held 2.369s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-11e24803-5ae6-4cde-8533-c64846a4d569" released by "delete_snapshot" :: held 2.403s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-d4d532ec-d58d-4509-ab2e-a4c5e6fbc991 req-71fd0078-6e54-463b-8414-185e9ff370e0 tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa" returned: 0 in 0.628s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-d4d532ec-d58d-4509-ab2e-a4c5e6fbc991 req-71fd0078-6e54-463b-8414-185e9ff370e0 tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-d4d532ec-d58d-4509-ab2e-a4c5e6fbc991 req-71fd0078-6e54-463b-8414-185e9ff370e0 tempest-TestServerVolumeAttachmentScenario-49585416 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-e460fe40-408e-4f95-92ab-024bfdb870fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5881849f-0306-4be8-8d78-a84bf6edf991', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:48:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-d4d532ec-d58d-4509-ab2e-a4c5e6fbc991 req-71fd0078-6e54-463b-8414-185e9ff370e0 tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:21 devstack cinder-volume[82609]: WARNING cinder.quota [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1031785746 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1031785746, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:48:21 devstack cinder-volume[82609]: WARNING cinder.quota [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1031785746 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1031785746, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:48:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-d4d532ec-d58d-4509-ab2e-a4c5e6fbc991 req-71fd0078-6e54-463b-8414-185e9ff370e0 tempest-TestServerVolumeAttachmentScenario-49585416 None] attachment_update completed successfully. Sep 10 17:48:21 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['d14241ed-5e14-480c-bb93-3f0b326e780b', '6ddcbc10-eba0-48bb-929e-6cc33934b04d', 'f5e2a93c-9d7d-4ce5-8d78-0970456b620d', '93d4e79c-f389-4a52-9b4a-32b90ff2f44b'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:22 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['f8be70d2-d9ac-4cab-a301-06112ae2aede', 'd89e2531-4b46-4178-9590-779b01e87a3a', '77175ad1-9151-4395-a63f-9f2f975a385f', '95dcc0df-a710-49e6-bb98-634956749fd3'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6c9c6a14-fd63-4f89-9bbc-3611fcdc088b tempest-GroupSnapshotsTest-1915941677 None] group_snapshot ed4dcaf1-6e3e-4854-9fd9-66eeb1e4a748: deleted successfully Sep 10 17:48:23 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-11e24803-5ae6-4cde-8533-c64846a4d569" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-11e24803-5ae6-4cde-8533-c64846a4d569" acquired by "delete_volume" :: waited 0.027s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4a522-5b5d-4a44-a2ee-5ee25e3073ab]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569" returned: 0 in 0.448s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-11e24803-5ae6-4cde-8533-c64846a4d569" returned: 0 in 0.118s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-11e24803-5ae6-4cde-8533-c64846a4d569" released by "delete_volume" :: held 0.751s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-ec84ed26-00ca-4d8e-b623-39b7ec92273d" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-ec84ed26-00ca-4d8e-b623-39b7ec92273d" acquired by "delete_volume" :: waited 0.024s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:24 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f5a39d-60e6-4b20-a0ff-fd435d943f1b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d" returned: 0 in 0.444s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec84ed26-00ca-4d8e-b623-39b7ec92273d" returned: 0 in 0.086s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-ec84ed26-00ca-4d8e-b623-39b7ec92273d" released by "delete_volume" :: held 0.677s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:25 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['c4220c8d-8daa-411d-a2b4-ec66edfd2fd3'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:25 devstack cinder-volume[82609]: WARNING cinder.quota [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1031785746 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1031785746, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:48:25 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['7529a8fa-ad36-4495-9f34-f9053fe284ae', '52e10d26-a1c4-4707-8592-67d302e91ef8', 'a718c367-e64e-4ef4-aefd-126f1c7165bb', 'e66f49f6-b1f8-455f-a4bf-2e5819d4fac9'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:25 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['e68fe539-1769-49f9-9915-6f7a0bb933b0', 'c6dc7a9d-2395-4324-a470-f039e613bb5b', '291266ad-d4db-4adb-905f-6e1ceb0283ff', '5e70ebed-55d8-4242-9bfb-20a9ea5868fa'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:48:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:48:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.122s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:48:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8d846c6c-bc8a-47ae-8f16-8e8c6319968f tempest-GroupSnapshotsTest-1915941677 None] Delete group completed successfully. Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.122s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:48:28 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f0e00135-1c8b-47c4-95bf-e84ee4d2dca6 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f0e00135-1c8b-47c4-95bf-e84ee4d2dca6 tempest-GroupSnapshotsTest-1915941677 None] Group tempest-GroupSnapshotsTest-Group-2000046249: creating Sep 10 17:48:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f0e00135-1c8b-47c4-95bf-e84ee4d2dca6 tempest-GroupSnapshotsTest-1915941677 None] Group tempest-GroupSnapshotsTest-Group-2000046249: created successfully Sep 10 17:48:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f0e00135-1c8b-47c4-95bf-e84ee4d2dca6 tempest-GroupSnapshotsTest-1915941677 None] Create group completed successfully. Sep 10 17:48:29 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Flow 'volume_create_manager' (a51d4ce5-7e16-41ff-aa74-bef9190d0d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3e9e9b-d741-4aa9-a25f-85735d412558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3e9e9b-d741-4aa9-a25f-85735d412558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152814045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=915de8ed-e452-4f8f-8a28-2be9a7a6209f,host='devstack@QuobyteHD#QuobyteHD',id=d304cbf2-33f4-43d7-92e4-f758f3e10784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d85a40748147768e046a3422a95876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:29Z,use_quota=True,user_id='500f1e6fc4b64cef82b4b6469c1a4d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11de7f7-4b36-4e4f-b48a-b250e219272c),volume_type_id=d11de7f7-4b36-4e4f-b48a-b250e219272c)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e883a04-90f1-4486-a76e-9e8f50069766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e883a04-90f1-4486-a76e-9e8f50069766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12538f7-faff-4d0d-8f45-4ebefba80c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12538f7-faff-4d0d-8f45-4ebefba80c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd304cbf2-33f4-43d7-92e4-f758f3e10784', 'volume_name': 'volume-d304cbf2-33f4-43d7-92e4-f758f3e10784', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0810fcb5-67c3-4db7-b2ca-521d95e34267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0810fcb5-67c3-4db7-b2ca-521d95e34267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97de2ca4-0c48-4f82-90d1-ed9c73a32a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:29 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Volume d304cbf2-33f4-43d7-92e4-f758f3e10784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d304cbf2-33f4-43d7-92e4-f758f3e10784', 'volume_size': 1} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=915de8ed-e452-4f8f-8a28-2be9a7a6209f,created_at=2025-09-10T15:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152814045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=915de8ed-e452-4f8f-8a28-2be9a7a6209f,host='devstack@QuobyteHD#QuobyteHD',id=d304cbf2-33f4-43d7-92e4-f758f3e10784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d85a40748147768e046a3422a95876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:29Z,use_quota=True,user_id='500f1e6fc4b64cef82b4b6469c1a4d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11de7f7-4b36-4e4f-b48a-b250e219272c),volume_type_id=d11de7f7-4b36-4e4f-b48a-b250e219272c)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Creating volume d304cbf2-33f4-43d7-92e4-f758f3e10784 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:48:29 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:48:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:29 devstack quobyte-client[82625]: System call of process 95215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:48:29 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=61, name=volume-d304cbf2-33f4-43d7-92e4-f758f3e10784, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 1073741824" returned: 0 in 0.380s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784" returned: 0 in 0.079s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] <== create_volume: return (527ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.544s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97de2ca4-0c48-4f82-90d1-ed9c73a32a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d304cbf2-33f4-43d7-92e4-f758f3e10784', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ca2075-2d97-4578-b9ec-a7573a0246cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:48:30 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Volume volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 (d304cbf2-33f4-43d7-92e4-f758f3e10784): created successfully Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ca2075-2d97-4578-b9ec-a7573a0246cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:48:30 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Flow 'volume_create_manager' (a51d4ce5-7e16-41ff-aa74-bef9190d0d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:48:30 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ee756d67-6e18-401f-9da8-d0afa5c6e199 tempest-GroupSnapshotsTest-1915941677 None] Created volume successfully. Sep 10 17:48:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] GroupSnapshot 92ebfa77-40db-4666-9aab-ff4d3cc5eca4: creating. Sep 10 17:48:32 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Group snapshot 92ebfa77-40db-4666-9aab-ff4d3cc5eca4: creating. {{(pid=82609) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 17:48:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Creating offline snapshot 483ad81b-7b02-4e34-8a0c-ff4065e1682f of volume d304cbf2-33f4-43d7-92e4-f758f3e10784 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:48:32 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[7896a3ff-8d50-4f17-b7cf-74b0171d5e5e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784" returned: 0 in 0.398s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:33 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=62, name=volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f 1G" returned: 0 in 0.253s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img rebase -u -b volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f" returned: 0 in 0.126s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f" returned: 0 in 0.076s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f" returned: 0 in 0.116s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.info" returned: 0 in 0.085s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.info" returned: 0 in 0.084s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.480s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5fcbeec1-fcac-42d3-803c-c244c8029f44 tempest-GroupSnapshotsTest-1915941677 None] group_snapshot 92ebfa77-40db-4666-9aab-ff4d3cc5eca4: created successfully Sep 10 17:48:35 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] group_snapshot 92ebfa77-40db-4666-9aab-ff4d3cc5eca4: deleting Sep 10 17:48:35 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] group_snapshot 92ebfa77-40db-4666-9aab-ff4d3cc5eca4: deleting {{(pid=82609) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-d304cbf2-33f4-43d7-92e4-f758f3e10784" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-d304cbf2-33f4-43d7-92e4-f758f3e10784" acquired by "delete_snapshot" :: waited 0.064s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-483ad81b-7b02-4e34-8a0c-ff4065e1682f" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-483ad81b-7b02-4e34-8a0c-ff4065e1682f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Deleting offline snapshot 483ad81b-7b02-4e34-8a0c-ff4065e1682f of volume d304cbf2-33f4-43d7-92e4-f758f3e10784 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] snapshot_file for this snap is: volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48e7f7c-30b2-450c-89c3-0aea0c6971fd]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:36 devstack quobyte-client[82625]: System call of process 95234 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:48:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f" returned: 0 in 0.403s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d304cbf2-33f4-43d7-92e4-f758f3e10784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:48:36 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f692783-3956-4eab-9e80-c5ba4b0af76d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784" returned: 0 in 0.389s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f" returned: 0 in 0.226s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784.483ad81b-7b02-4e34-8a0c-ff4065e1682f" returned: 0 in 0.084s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-483ad81b-7b02-4e34-8a0c-ff4065e1682f" released by "_delete_snapshot" :: held 1.449s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-d304cbf2-33f4-43d7-92e4-f758f3e10784" released by "delete_snapshot" :: held 1.472s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:37 devstack cinder-volume[82609]: WARNING cinder.quota [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-636639298 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-636639298, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:48:37 devstack cinder-volume[82609]: WARNING cinder.quota [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-636639298 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-636639298, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:48:37 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['87246a0c-520b-4a30-948e-eede55aa84c4', '9f824b40-4f0a-400f-9091-9299b55aa74e', 'd8a35f74-9735-4796-af4d-107fe4d4740b', 'f7f98c03-7462-428b-9937-a45942ea1754'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:37 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ea379fb0-9a93-4680-85f8-98686a57c6a2 tempest-GroupSnapshotsTest-1915941677 None] group_snapshot 92ebfa77-40db-4666-9aab-ff4d3cc5eca4: deleted successfully Sep 10 17:48:38 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "cinder-quobyte-d304cbf2-33f4-43d7-92e4-f758f3e10784" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-d304cbf2-33f4-43d7-92e4-f758f3e10784" acquired by "delete_volume" :: waited 0.032s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:38 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbc0302-444f-4d50-9187-b7f78051451c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784" returned: 0 in 0.558s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d304cbf2-33f4-43d7-92e4-f758f3e10784" returned: 0 in 0.138s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Lock "cinder-quobyte-d304cbf2-33f4-43d7-92e4-f758f3e10784" released by "delete_volume" :: held 0.951s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['7c017606-c48b-485c-a095-f1b90f07d923'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:39 devstack cinder-volume[82609]: WARNING cinder.quota [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-636639298 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-636639298, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Created reservations ['ca79cd21-741f-414c-8a4e-9bb13220048c', '43f85584-3cde-428d-8b55-7a6cb1f15449', '4b6461c1-66b6-4124-8d4b-3efb99137cf4', '9e6dd152-54da-4acb-912b-b0540f991807'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.093s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:40 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:48:40 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0d616f3c-8629-40c9-89ff-0b8dca91548e tempest-GroupSnapshotsTest-1915941677 None] Delete group completed successfully. Sep 10 17:48:41 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-7a66252d-d099-4883-8abf-fcfe7d494e5d req-fec29c79-9f14-45dd-b6ea-88e585f557cc tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:41 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-7a66252d-d099-4883-8abf-fcfe7d494e5d req-fec29c79-9f14-45dd-b6ea-88e585f557cc tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:41 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-7a66252d-d099-4883-8abf-fcfe7d494e5d req-fec29c79-9f14-45dd-b6ea-88e585f557cc tempest-AttachVolumeTestJSON-1826446911 None] Terminate volume connection completed successfully. Sep 10 17:48:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-7a66252d-d099-4883-8abf-fcfe7d494e5d req-fec29c79-9f14-45dd-b6ea-88e585f557cc tempest-AttachVolumeTestJSON-1826446911 None] Deleting attachment afbb0ac6-39ab-4545-8c2a-914597234ce7. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:48:50 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-f3ed5a80-620b-4161-a148-76d8ad4dc50e req-38870e30-23ec-4545-ada2-b1ee823daf88 tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:50 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=114,cinder:UPDATE=82,cinder:INSERT=22,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:48:50 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=112,cinder:SELECT=112,cinder:INSERT=18,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:48:50 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-f3ed5a80-620b-4161-a148-76d8ad4dc50e req-38870e30-23ec-4545-ada2-b1ee823daf88 tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-f3ed5a80-620b-4161-a148-76d8ad4dc50e req-38870e30-23ec-4545-ada2-b1ee823daf88 tempest-TestServerVolumeAttachmentScenario-49585416 None] Terminate volume connection completed successfully. Sep 10 17:48:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-f3ed5a80-620b-4161-a148-76d8ad4dc50e req-38870e30-23ec-4545-ada2-b1ee823daf88 tempest-TestServerVolumeAttachmentScenario-49585416 None] Deleting attachment 5881849f-0306-4be8-8d78-a84bf6edf991. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:48:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "cinder-4d4c00c1-2935-4339-ac2f-7eb829be4576-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-4d4c00c1-2935-4339-ac2f-7eb829be4576-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "cinder-quobyte-4d4c00c1-2935-4339-ac2f-7eb829be4576" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-quobyte-4d4c00c1-2935-4339-ac2f-7eb829be4576" acquired by "delete_volume" :: waited 0.014s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:56 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1190a1d-29a5-4bf5-8341-fd3726874420]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576" returned: 0 in 0.510s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4c00c1-2935-4339-ac2f-7eb829be4576" returned: 0 in 0.115s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-quobyte-4d4c00c1-2935-4339-ac2f-7eb829be4576" released by "delete_volume" :: held 0.818s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Created reservations ['e91fa927-87c9-4916-b8e3-e6e787b1f5fe', '5d7d162a-058c-4cc1-b069-dad2efca9676', 'f24ee24f-b3a2-42d3-a86e-2b84b535f90b', '9c35c018-7355-4ed5-a798-e4bd945acb3f'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.113s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:48:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Deleted volume successfully. Sep 10 17:48:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-92497a55-050e-4076-ae37-904c2e86e2b8 tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-4d4c00c1-2935-4339-ac2f-7eb829be4576-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:48:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "cinder-01383c33-aaa6-4265-92af-79e6256eb888-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-01383c33-aaa6-4265-92af-79e6256eb888-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:59 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:48:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "cinder-quobyte-01383c33-aaa6-4265-92af-79e6256eb888" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:48:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-quobyte-01383c33-aaa6-4265-92af-79e6256eb888" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:48:59 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3190221b-2014-4939-bc2d-0fe7968e6ee2]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:48:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:48:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888" returned: 0 in 0.436s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:48:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-01383c33-aaa6-4265-92af-79e6256eb888" returned: 0 in 0.381s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-quobyte-01383c33-aaa6-4265-92af-79e6256eb888" released by "delete_volume" :: held 0.948s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:00 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Flow 'volume_create_manager' (9d2b9190-4ca1-4b24-806b-269ed3fe7879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ccd5be-0e7b-4725-b700-a515d84d9492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ccd5be-0e7b-4725-b700-a515d84d9492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1451509827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f655aab7-7856-4168-90b8-a7a165349d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce78ed716c844029148f0f08ee2734f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:00Z,use_quota=True,user_id='5621fe8dc6674e5a96e68f375e27935b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5088f97a-e3e4-487c-a341-3c7e873a32ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5088f97a-e3e4-487c-a341-3c7e873a32ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d193463-01af-4d4e-b34f-08ad95537bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d193463-01af-4d4e-b34f-08ad95537bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f655aab7-7856-4168-90b8-a7a165349d24', 'volume_name': 'volume-f655aab7-7856-4168-90b8-a7a165349d24', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241453ca-5f8e-4208-8b2a-c6e12ef41478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241453ca-5f8e-4208-8b2a-c6e12ef41478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951c2108-622f-4ba0-840e-da01a8b51d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:00 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume f655aab7-7856-4168-90b8-a7a165349d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f655aab7-7856-4168-90b8-a7a165349d24', 'volume_size': 1} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1451509827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f655aab7-7856-4168-90b8-a7a165349d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce78ed716c844029148f0f08ee2734f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:00Z,use_quota=True,user_id='5621fe8dc6674e5a96e68f375e27935b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Creating volume f655aab7-7856-4168-90b8-a7a165349d24 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:00 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f655aab7-7856-4168-90b8-a7a165349d24 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:00 devstack quobyte-client[82625]: System call of process 95398 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:49:00 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=64, name=volume-f655aab7-7856-4168-90b8-a7a165349d24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Created reservations ['f183a112-f079-49c8-b0e0-0e4cd619a759', '5ea31abc-8960-4b17-ab58-0d5db80ea744', 'df40a758-6142-4cc9-b016-941676ed06d5', '0667e637-e4cf-4a82-9140-27ea2b972453'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f655aab7-7856-4168-90b8-a7a165349d24 1073741824" returned: 0 in 0.506s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f655aab7-7856-4168-90b8-a7a165349d24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f655aab7-7856-4168-90b8-a7a165349d24" returned: 0 in 0.235s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951c2108-622f-4ba0-840e-da01a8b51d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f655aab7-7856-4168-90b8-a7a165349d24', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486f19b7-90ca-461e-8343-89c97ef7c91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:01 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume volume-f655aab7-7856-4168-90b8-a7a165349d24 (f655aab7-7856-4168-90b8-a7a165349d24): created successfully Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486f19b7-90ca-461e-8343-89c97ef7c91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Flow 'volume_create_manager' (9d2b9190-4ca1-4b24-806b-269ed3fe7879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-a748a95d-37e4-472f-bd78-461948be29bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Created volume successfully. Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.092s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:01 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Deleted volume successfully. Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3f5bc200-9084-4fae-8f12-6e5565be3fb1 tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-01383c33-aaa6-4265-92af-79e6256eb888-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Acquiring lock "cinder-f655aab7-7856-4168-90b8-a7a165349d24-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "cinder-f655aab7-7856-4168-90b8-a7a165349d24-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:02 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Acquiring lock "cinder-quobyte-f655aab7-7856-4168-90b8-a7a165349d24" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "cinder-quobyte-f655aab7-7856-4168-90b8-a7a165349d24" acquired by "delete_volume" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d0b509-fbe6-4f6d-bef6-981e3bc9e1f6]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f655aab7-7856-4168-90b8-a7a165349d24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "cinder-a62b1389-d6c4-433c-9db3-3873b8282660-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-a62b1389-d6c4-433c-9db3-3873b8282660-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f655aab7-7856-4168-90b8-a7a165349d24" returned: 0 in 0.629s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f655aab7-7856-4168-90b8-a7a165349d24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f655aab7-7856-4168-90b8-a7a165349d24" returned: 0 in 0.274s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "cinder-quobyte-f655aab7-7856-4168-90b8-a7a165349d24" released by "delete_volume" :: held 1.044s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:03 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "cinder-quobyte-a62b1389-d6c4-433c-9db3-3873b8282660" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-quobyte-a62b1389-d6c4-433c-9db3-3873b8282660" acquired by "delete_volume" :: waited 0.042s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:03 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[829c22da-10bd-4def-8ae3-75c88c968215]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Created reservations ['585799ff-b61f-441f-bd3a-52123c428668', 'ee425aff-1029-42e1-81bf-777ceefd99dc', 'f8cb7d55-9315-48cc-b596-ccb42ed0b44f', '0ef84007-5d3d-4e3d-b59a-7c2e2230d055'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660" returned: 0 in 0.638s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a62b1389-d6c4-433c-9db3-3873b8282660" returned: 0 in 0.328s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.270s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-quobyte-a62b1389-d6c4-433c-9db3-3873b8282660" released by "delete_volume" :: held 1.153s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:04 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Deleted volume successfully. Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-280898ad-284a-4582-a62f-0aadb604f223 tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "cinder-f655aab7-7856-4168-90b8-a7a165349d24-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Created reservations ['b8d26ba8-649d-4c69-9500-7e459647a5dc', '3befd3bf-1b55-40c8-a03c-53a88c920992', '13da9758-2403-4a20-9ee4-03a6c9412037', '17fa09ca-a40d-4005-a164-59f2ff0d7460'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:05 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Flow 'volume_create_manager' (015f80b6-5402-44a4-9aba-188757dc8474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e73b55-12b8-4160-8e12-df47dc9e4ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e73b55-12b8-4160-8e12-df47dc9e4ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1038006303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ede396-fb06-412b-9403-472a6d3d6e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce78ed716c844029148f0f08ee2734f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:05Z,use_quota=True,user_id='5621fe8dc6674e5a96e68f375e27935b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006f0284-61e9-428d-bc07-b050912a07ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006f0284-61e9-428d-bc07-b050912a07ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701eaa22-2572-413b-87b4-e839b0c1833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701eaa22-2572-413b-87b4-e839b0c1833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ede396-fb06-412b-9403-472a6d3d6e56', 'volume_name': 'volume-c9ede396-fb06-412b-9403-472a6d3d6e56', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b133e982-f89c-48e8-96a9-e713cc8d991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b133e982-f89c-48e8-96a9-e713cc8d991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba45efb6-95cf-4abd-bf20-9e214b132644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:05 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume c9ede396-fb06-412b-9403-472a6d3d6e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ede396-fb06-412b-9403-472a6d3d6e56', 'volume_size': 1} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1038006303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ede396-fb06-412b-9403-472a6d3d6e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce78ed716c844029148f0f08ee2734f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:05Z,use_quota=True,user_id='5621fe8dc6674e5a96e68f375e27935b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Creating volume c9ede396-fb06-412b-9403-472a6d3d6e56 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:05 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c9ede396-fb06-412b-9403-472a6d3d6e56 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:05 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=65, name=volume-c9ede396-fb06-412b-9403-472a6d3d6e56, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c9ede396-fb06-412b-9403-472a6d3d6e56 1073741824" returned: 0 in 0.404s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c9ede396-fb06-412b-9403-472a6d3d6e56 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c9ede396-fb06-412b-9403-472a6d3d6e56" returned: 0 in 0.267s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] <== create_volume: return (745ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.165s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:06 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Deleted volume successfully. Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba45efb6-95cf-4abd-bf20-9e214b132644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ede396-fb06-412b-9403-472a6d3d6e56', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec3b26a-3a27-45c1-a471-72e23f3d01d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:06 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Volume volume-c9ede396-fb06-412b-9403-472a6d3d6e56 (c9ede396-fb06-412b-9403-472a6d3d6e56): created successfully Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec3b26a-3a27-45c1-a471-72e23f3d01d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Flow 'volume_create_manager' (015f80b6-5402-44a4-9aba-188757dc8474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f29c4cbd-a89f-4cb7-a28b-006a6093fe1d tempest-AttachVolumeTestJSON-1826446911 None] Lock "cinder-a62b1389-d6c4-433c-9db3-3873b8282660-delete_volume" released by "delete_volume" :: held 3.992s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:06 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-fe5a0b61-24fa-4f95-a2e8-57f08ca704bc tempest-VolumeQuotasAdminTestJSON-1179820934 None] Created volume successfully. Sep 10 17:49:08 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-faa74ff7-0ff0-4716-aa0f-c8496977c088 tempest-VolumeQuotasAdminTestJSON-156721084 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:08 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-faa74ff7-0ff0-4716-aa0f-c8496977c088 tempest-VolumeQuotasAdminTestJSON-156721084 None] Transfer volume completed successfully. Sep 10 17:49:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Acquiring lock "cinder-c9ede396-fb06-412b-9403-472a6d3d6e56-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Lock "cinder-c9ede396-fb06-412b-9403-472a6d3d6e56-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:09 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Acquiring lock "cinder-quobyte-c9ede396-fb06-412b-9403-472a6d3d6e56" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Lock "cinder-quobyte-c9ede396-fb06-412b-9403-472a6d3d6e56" acquired by "delete_volume" :: waited 0.027s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[348b28f5-c830-4aaa-8f19-7157e8f9f743]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c9ede396-fb06-412b-9403-472a6d3d6e56 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:10 devstack quobyte-client[82625]: System call of process 95427 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:49:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c9ede396-fb06-412b-9403-472a6d3d6e56" returned: 0 in 0.653s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c9ede396-fb06-412b-9403-472a6d3d6e56 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c9ede396-fb06-412b-9403-472a6d3d6e56" returned: 0 in 0.121s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Lock "cinder-quobyte-c9ede396-fb06-412b-9403-472a6d3d6e56" released by "delete_volume" :: held 0.975s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Created reservations ['d7b0e9d3-4a05-4d46-a0f4-76709e2fbac0', '6ca68396-efca-4162-b651-6e201ce1a8be', 'd9bf28cc-c157-4118-8afe-4e55fbf0ed7f', '9b4411af-511d-410e-9861-a999bc0be6a4'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.210s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:11 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Deleted volume successfully. Sep 10 17:49:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-73dac172-05d1-4775-b324-26ddb4639877 tempest-VolumeQuotasAdminTestJSON-565407193 None] Lock "cinder-c9ede396-fb06-412b-9403-472a6d3d6e56-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-48f90ffe-24a0-4d74-a6b4-15552b5f709e req-8c9ca9af-9da0-4c65-b130-dd0ced2717ae tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-48f90ffe-24a0-4d74-a6b4-15552b5f709e req-8c9ca9af-9da0-4c65-b130-dd0ced2717ae tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-48f90ffe-24a0-4d74-a6b4-15552b5f709e req-8c9ca9af-9da0-4c65-b130-dd0ced2717ae tempest-TestServerVolumeAttachmentScenario-49585416 None] Terminate volume connection completed successfully. Sep 10 17:49:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-48f90ffe-24a0-4d74-a6b4-15552b5f709e req-8c9ca9af-9da0-4c65-b130-dd0ced2717ae tempest-TestServerVolumeAttachmentScenario-49585416 None] Deleting attachment f8757007-26f7-445d-b058-0043aab8534c. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:49:20 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Flow 'volume_create_manager' (87275fca-dd4a-4d7d-a6a0-c8c1752f8e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53880851-0399-4c65-bc9e-a485d728cfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53880851-0399-4c65-bc9e-a485d728cfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1059988772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d58e97-02aa-48bb-9653-4b7405ca1c9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='64389a2566dc404c8755a502e91b7fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:20Z,use_quota=True,user_id='83b1e68f2e944dd5b41c5fcb5af5bfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b3a060-bea9-4c18-b166-d846b0d231ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b3a060-bea9-4c18-b166-d846b0d231ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093c6a2-165c-4468-a83a-956f1a1ff4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093c6a2-165c-4468-a83a-956f1a1ff4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d58e97-02aa-48bb-9653-4b7405ca1c9b', 'volume_name': 'volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0587aa-d4ff-4d87-9c13-a1e1725fd4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0587aa-d4ff-4d87-9c13-a1e1725fd4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16811fae-56c2-4b9b-ba53-0c577a77c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:20 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Volume d5d58e97-02aa-48bb-9653-4b7405ca1c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b', 'volume_size': 1} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1059988772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d58e97-02aa-48bb-9653-4b7405ca1c9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='64389a2566dc404c8755a502e91b7fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:20Z,use_quota=True,user_id='83b1e68f2e944dd5b41c5fcb5af5bfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Creating volume d5d58e97-02aa-48bb-9653-4b7405ca1c9b {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:20 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:20 devstack quobyte-client[82625]: System call of process 95481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:49:20 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=66, name=volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b 1073741824" returned: 0 in 0.670s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b" returned: 0 in 0.120s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] <== create_volume: return (856ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16811fae-56c2-4b9b-ba53-0c577a77c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d005d6-7f0e-43a7-90e1-f5c80d8b7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:22 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Volume volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b (d5d58e97-02aa-48bb-9653-4b7405ca1c9b): created successfully Sep 10 17:49:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d005d6-7f0e-43a7-90e1-f5c80d8b7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Flow 'volume_create_manager' (87275fca-dd4a-4d7d-a6a0-c8c1752f8e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-1932fbef-fc0c-4b28-8a37-22e9270f1a94 req-a1f08eb9-f569-41f4-8564-24f985ef1613 tempest-VolumesGetTestJSON-848282281 None] Created volume successfully. Sep 10 17:49:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Acquiring lock "cinder-d5d58e97-02aa-48bb-9653-4b7405ca1c9b-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Lock "cinder-d5d58e97-02aa-48bb-9653-4b7405ca1c9b-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Acquiring lock "cinder-quobyte-d5d58e97-02aa-48bb-9653-4b7405ca1c9b" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Lock "cinder-quobyte-d5d58e97-02aa-48bb-9653-4b7405ca1c9b" acquired by "delete_volume" :: waited 0.013s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:24 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc848dab-91ae-4e08-b9ce-0a35d75d3070]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b" returned: 0 in 0.552s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d5d58e97-02aa-48bb-9653-4b7405ca1c9b" returned: 0 in 0.194s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Lock "cinder-quobyte-d5d58e97-02aa-48bb-9653-4b7405ca1c9b" released by "delete_volume" :: held 1.101s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:25 devstack cinder-volume[82609]: DEBUG cinder.quota [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Created reservations ['10716cf1-2b6b-431d-8e57-3059ec31d6a8', 'a517302a-8e7d-45c6-b05a-cdd3b5f693c9', 'e82848a1-aae2-4205-8fbf-c4ef91c1e818', '89a7066d-e102-45e9-8d88-4bdadae86c1a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.206s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG cinder.manager [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Deleted volume successfully. Sep 10 17:49:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-0f56cbd1-a214-4073-9899-933217f6a10f req-05eb1766-ec21-4431-a4fe-2228a89b3efc tempest-VolumesGetTestJSON-848282281 None] Lock "cinder-d5d58e97-02aa-48bb-9653-4b7405ca1c9b-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.171s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "cinder-e460fe40-408e-4f95-92ab-024bfdb870fa-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "cinder-e460fe40-408e-4f95-92ab-024bfdb870fa-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:30 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "cinder-quobyte-e460fe40-408e-4f95-92ab-024bfdb870fa" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "cinder-quobyte-e460fe40-408e-4f95-92ab-024bfdb870fa" acquired by "delete_volume" :: waited 0.023s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:30 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bafad1-5345-4d02-9164-02d8b0df9c38]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa" returned: 0 in 0.548s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e460fe40-408e-4f95-92ab-024bfdb870fa" returned: 0 in 0.171s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "cinder-quobyte-e460fe40-408e-4f95-92ab-024bfdb870fa" released by "delete_volume" :: held 1.017s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Created reservations ['4926cec6-8e31-4713-b6f3-e29930f82902', '9ded0de6-2bab-4b44-b7bf-841b31d843c1', '241fbc8f-b81b-41cb-aebe-da2e1612b170', '9e0a9f4b-73e8-44ee-bf1a-1265e0a43554'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.140s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Deleted volume successfully. Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "cinder-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:32 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b3f48368-90d4-467d-a25b-885a4cf502cd tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b3f48368-90d4-467d-a25b-885a4cf502cd tempest-GroupsTest-483175920 None] Group tempest-Group1-1273828208: creating Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0a29d313-9fe9-4d64-8144-cfd73420975f tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "cinder-e460fe40-408e-4f95-92ab-024bfdb870fa-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "cinder-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b3f48368-90d4-467d-a25b-885a4cf502cd tempest-GroupsTest-483175920 None] Group tempest-Group1-1273828208: created successfully Sep 10 17:49:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b3f48368-90d4-467d-a25b-885a4cf502cd tempest-GroupsTest-483175920 None] Create group completed successfully. Sep 10 17:49:32 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "cinder-quobyte-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "cinder-quobyte-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d" acquired by "delete_volume" :: waited 0.016s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:33 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b718c75b-aa70-4bd3-a7cd-103139002190]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d" returned: 0 in 0.494s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d" returned: 0 in 0.108s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-cdd9e36f-51a0-49c8-92ca-b6e31c2f7850 tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-cdd9e36f-51a0-49c8-92ca-b6e31c2f7850 tempest-GroupsTest-483175920 None] Group tempest-Group2-1282165239: creating Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "cinder-quobyte-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d" released by "delete_volume" :: held 1.098s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-cdd9e36f-51a0-49c8-92ca-b6e31c2f7850 tempest-GroupsTest-483175920 None] Group tempest-Group2-1282165239: created successfully Sep 10 17:49:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-cdd9e36f-51a0-49c8-92ca-b6e31c2f7850 tempest-GroupsTest-483175920 None] Create group completed successfully. Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Created reservations ['10ace29a-91e9-4b5d-9a6f-920c58c6f5aa', '03b51d48-e5bf-47b2-ac88-c83ccc649c96', 'e0e260d8-7f31-40ff-8f38-87d31dcfed72', 'b1a233f1-17f2-4aab-b138-6b9c7ad912c3'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.136s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:34 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:35 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Deleted volume successfully. Sep 10 17:49:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dde8f258-fead-47a9-b64b-3046fac0114e tempest-TestServerVolumeAttachmentScenario-49585416 None] Lock "cinder-0f7ac75b-4d79-4fbb-9248-e4096dfe8e2d-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Flow 'volume_create_manager' (66756c9c-ce7a-4562-8b59-60b60068196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5aad2ee-f552-48d0-8bc5-2e7bfe6bbaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5aad2ee-f552-48d0-8bc5-2e7bfe6bbaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1636157028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b5be1a6-5699-41c2-90d4-d81a172ff500,host='devstack@QuobyteHD#QuobyteHD',id=88f66ac5-15cc-4393-a117-ea5fea451c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421749338ca542cba120abde30f2b4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:36Z,use_quota=True,user_id='16f3c5017e41455cb1b5891f9e80544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b10b0edf-1ac6-4b00-8059-96a559ac0807),volume_type_id=b10b0edf-1ac6-4b00-8059-96a559ac0807)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3371fa-80e7-4bfa-a2b9-efe38222ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3371fa-80e7-4bfa-a2b9-efe38222ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2195e0a2-0f1a-483b-9587-483c5b59cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2195e0a2-0f1a-483b-9587-483c5b59cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f66ac5-15cc-4393-a117-ea5fea451c26', 'volume_name': 'volume-88f66ac5-15cc-4393-a117-ea5fea451c26', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50067334-830f-4aa6-b0f6-871a2acf4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50067334-830f-4aa6-b0f6-871a2acf4584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31632404-4c7b-4187-8c0e-9a4b3d74dfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:36 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Volume 88f66ac5-15cc-4393-a117-ea5fea451c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f66ac5-15cc-4393-a117-ea5fea451c26', 'volume_size': 1} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2b5be1a6-5699-41c2-90d4-d81a172ff500,created_at=2025-09-10T15:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1636157028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b5be1a6-5699-41c2-90d4-d81a172ff500,host='devstack@QuobyteHD#QuobyteHD',id=88f66ac5-15cc-4393-a117-ea5fea451c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421749338ca542cba120abde30f2b4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:36Z,use_quota=True,user_id='16f3c5017e41455cb1b5891f9e80544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b10b0edf-1ac6-4b00-8059-96a559ac0807),volume_type_id=b10b0edf-1ac6-4b00-8059-96a559ac0807)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Creating volume 88f66ac5-15cc-4393-a117-ea5fea451c26 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:36 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-88f66ac5-15cc-4393-a117-ea5fea451c26 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:36 devstack quobyte-client[82625]: System call of process 95506 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:49:36 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=67, name=volume-88f66ac5-15cc-4393-a117-ea5fea451c26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-88f66ac5-15cc-4393-a117-ea5fea451c26 1073741824" returned: 0 in 0.454s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-88f66ac5-15cc-4393-a117-ea5fea451c26 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-88f66ac5-15cc-4393-a117-ea5fea451c26" returned: 0 in 0.257s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] <== create_volume: return (809ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31632404-4c7b-4187-8c0e-9a4b3d74dfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f66ac5-15cc-4393-a117-ea5fea451c26', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c101cde5-c76d-482e-96f9-1465d9b9acff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:37 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Volume volume-88f66ac5-15cc-4393-a117-ea5fea451c26 (88f66ac5-15cc-4393-a117-ea5fea451c26): created successfully Sep 10 17:49:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c101cde5-c76d-482e-96f9-1465d9b9acff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Flow 'volume_create_manager' (66756c9c-ce7a-4562-8b59-60b60068196f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:37 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-085df187-845d-4f1d-843f-d1d6ba11b467 tempest-GroupsTest-483175920 None] Created volume successfully. Sep 10 17:49:39 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Acquiring lock "cinder-quobyte-88f66ac5-15cc-4393-a117-ea5fea451c26" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Lock "cinder-quobyte-88f66ac5-15cc-4393-a117-ea5fea451c26" acquired by "delete_volume" :: waited 0.105s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:39 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef6ce5b-b049-47b0-979c-84780ea29ee0]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-88f66ac5-15cc-4393-a117-ea5fea451c26 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-88f66ac5-15cc-4393-a117-ea5fea451c26" returned: 0 in 0.830s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-88f66ac5-15cc-4393-a117-ea5fea451c26 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-88f66ac5-15cc-4393-a117-ea5fea451c26" returned: 0 in 0.160s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Lock "cinder-quobyte-88f66ac5-15cc-4393-a117-ea5fea451c26" released by "delete_volume" :: held 1.328s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:41 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Created reservations ['ff460a63-8524-4d1c-abbc-d30bb524259f'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:41 devstack cinder-volume[82609]: WARNING cinder.quota [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-406027928 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-406027928, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:49:41 devstack cinder-volume[82609]: WARNING cinder.quota [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-406027928 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-406027928, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:49:41 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Created reservations ['76c9371d-f69d-49f5-a58f-b273073784c9', 'b994dda8-8fd3-4231-a8e2-73a398b59d2f', '0f28f56a-eda1-499b-ab80-54c6f1943207', '19a3775b-19ff-415c-afd0-0e0cae23e717'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:42 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.529s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:42 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-301d25be-dd03-48a8-b51c-fabde0646200 tempest-GroupsTest-483175920 None] Delete group completed successfully. Sep 10 17:49:42 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Created reservations ['7dff7434-3907-44af-9020-4bb508e9caaf'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:43 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:43 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.163s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:43 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:49:43 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4ede4da3-e76c-4325-91e7-517021d4f6d7 tempest-GroupsTest-483175920 None] Delete group completed successfully. Sep 10 17:49:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b9638513-3efa-4432-aa85-654b5f797d1e tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:45 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b9638513-3efa-4432-aa85-654b5f797d1e tempest-GroupsTest-483175920 None] Group tempest-GroupsTest-Group-366240578: creating Sep 10 17:49:45 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b9638513-3efa-4432-aa85-654b5f797d1e tempest-GroupsTest-483175920 None] Group tempest-GroupsTest-Group-366240578: created successfully Sep 10 17:49:45 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b9638513-3efa-4432-aa85-654b5f797d1e tempest-GroupsTest-483175920 None] Create group completed successfully. Sep 10 17:49:46 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:46 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Flow 'volume_create_manager' (8e05ddb4-8327-4472-a5cc-b57865e7ea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b4cbe3-5f56-4f95-aa1e-4a606d54de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b4cbe3-5f56-4f95-aa1e-4a606d54de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126904410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51d927b0-7373-41e0-9514-ee238f84a387,host='devstack@QuobyteHD#QuobyteHD',id=3c4cea7a-5266-491d-8628-49d32daccfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421749338ca542cba120abde30f2b4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:47Z,use_quota=True,user_id='16f3c5017e41455cb1b5891f9e80544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a407511-c68d-461b-9ebe-946b4d998b6f),volume_type_id=8a407511-c68d-461b-9ebe-946b4d998b6f)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc57fdc-e0fa-4b88-9348-a7ebab44a18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc57fdc-e0fa-4b88-9348-a7ebab44a18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79554403-f49d-41fd-aa46-72827b8a097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79554403-f49d-41fd-aa46-72827b8a097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4cea7a-5266-491d-8628-49d32daccfd9', 'volume_name': 'volume-3c4cea7a-5266-491d-8628-49d32daccfd9', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606b3a74-2248-437a-8a16-163a37f92c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606b3a74-2248-437a-8a16-163a37f92c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7668d82-c321-41a7-8fd2-651e279bea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:47 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Volume 3c4cea7a-5266-491d-8628-49d32daccfd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4cea7a-5266-491d-8628-49d32daccfd9', 'volume_size': 1} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51d927b0-7373-41e0-9514-ee238f84a387,created_at=2025-09-10T15:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126904410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51d927b0-7373-41e0-9514-ee238f84a387,host='devstack@QuobyteHD#QuobyteHD',id=3c4cea7a-5266-491d-8628-49d32daccfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421749338ca542cba120abde30f2b4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:47Z,use_quota=True,user_id='16f3c5017e41455cb1b5891f9e80544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a407511-c68d-461b-9ebe-946b4d998b6f),volume_type_id=8a407511-c68d-461b-9ebe-946b4d998b6f)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Creating volume 3c4cea7a-5266-491d-8628-49d32daccfd9 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:47 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c4cea7a-5266-491d-8628-49d32daccfd9 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:47 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=68, name=volume-3c4cea7a-5266-491d-8628-49d32daccfd9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:47 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Flow 'volume_create_manager' (a364cf0b-f816-4a89-a62f-30f38bb2bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e1f615-222f-471b-9f71-b40c3cac9b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c4cea7a-5266-491d-8628-49d32daccfd9 1073741824" returned: 0 in 0.756s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c4cea7a-5266-491d-8628-49d32daccfd9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e1f615-222f-471b-9f71-b40c3cac9b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1000157640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8934c0-99d2-409e-9338-6d6b4a31cd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bf3646307b4742a9c89a77a1731f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:47Z,use_quota=True,user_id='ad8c01aa80bc46149902db341137bef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a54dd1-8d72-4891-afbc-e1ceb0b826c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a54dd1-8d72-4891-afbc-e1ceb0b826c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba8f0ce-d9b7-4367-84cc-29967f9d4904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba8f0ce-d9b7-4367-84cc-29967f9d4904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8934c0-99d2-409e-9338-6d6b4a31cd49', 'volume_name': 'volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2226958e-446e-4896-80ba-93f20bc993da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2226958e-446e-4896-80ba-93f20bc993da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d02310-6d8b-4d23-aa3f-7969681a0ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Volume 5c8934c0-99d2-409e-9338-6d6b4a31cd49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49', 'volume_size': 1} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c4cea7a-5266-491d-8628-49d32daccfd9" returned: 0 in 0.378s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] <== create_volume: return (1155ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.102s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1000157640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8934c0-99d2-409e-9338-6d6b4a31cd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bf3646307b4742a9c89a77a1731f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:47Z,use_quota=True,user_id='ad8c01aa80bc46149902db341137bef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Creating volume 5c8934c0-99d2-409e-9338-6d6b4a31cd49 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:48 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:48 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=69, name=volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7668d82-c321-41a7-8fd2-651e279bea2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4cea7a-5266-491d-8628-49d32daccfd9', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a131f6-8b2f-4168-814a-ab4f96c862f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Volume volume-3c4cea7a-5266-491d-8628-49d32daccfd9 (3c4cea7a-5266-491d-8628-49d32daccfd9): created successfully Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a131f6-8b2f-4168-814a-ab4f96c862f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Flow 'volume_create_manager' (8e05ddb4-8327-4472-a5cc-b57865e7ea7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49 1073741824" returned: 0 in 0.431s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-026b1dcf-2e58-4b14-998a-6e11c8c0496d tempest-GroupsTest-483175920 None] Created volume successfully. Sep 10 17:49:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49" returned: 0 in 0.284s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] <== create_volume: return (744ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d02310-6d8b-4d23-aa3f-7969681a0ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e324f6-464d-4281-bc5c-855515bbd0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:49 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Volume volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49 (5c8934c0-99d2-409e-9338-6d6b4a31cd49): created successfully Sep 10 17:49:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e324f6-464d-4281-bc5c-855515bbd0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Flow 'volume_create_manager' (a364cf0b-f816-4a89-a62f-30f38bb2bcde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:49 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f069cbb0-68ef-4215-840c-62f57eefce95 tempest-VolumesListAdminTestJSON-792894313 None] Created volume successfully. Sep 10 17:49:49 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Flow 'volume_create_manager' (26aa7032-8979-40cc-8542-dd0a3f552055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44abf035-535e-42d3-b8d0-e9b016aeea63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44abf035-535e-42d3-b8d0-e9b016aeea63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566932695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51d927b0-7373-41e0-9514-ee238f84a387,host='devstack@QuobyteHD#QuobyteHD',id=425dd1b5-9926-4307-b44e-7348ace4caf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421749338ca542cba120abde30f2b4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:50Z,use_quota=True,user_id='16f3c5017e41455cb1b5891f9e80544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a407511-c68d-461b-9ebe-946b4d998b6f),volume_type_id=8a407511-c68d-461b-9ebe-946b4d998b6f)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e88b317-12ec-4268-831e-a404bcc90347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e88b317-12ec-4268-831e-a404bcc90347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b7574c-840d-45c6-bc86-38f3f83b7305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b7574c-840d-45c6-bc86-38f3f83b7305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425dd1b5-9926-4307-b44e-7348ace4caf3', 'volume_name': 'volume-425dd1b5-9926-4307-b44e-7348ace4caf3', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a00530e-4154-4375-bc35-27e51106bcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a00530e-4154-4375-bc35-27e51106bcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b5bbc9-9e6e-43b6-b168-dd4d8c8827ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:50 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Volume 425dd1b5-9926-4307-b44e-7348ace4caf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425dd1b5-9926-4307-b44e-7348ace4caf3', 'volume_size': 1} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51d927b0-7373-41e0-9514-ee238f84a387,created_at=2025-09-10T15:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566932695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51d927b0-7373-41e0-9514-ee238f84a387,host='devstack@QuobyteHD#QuobyteHD',id=425dd1b5-9926-4307-b44e-7348ace4caf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421749338ca542cba120abde30f2b4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:50Z,use_quota=True,user_id='16f3c5017e41455cb1b5891f9e80544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a407511-c68d-461b-9ebe-946b4d998b6f),volume_type_id=8a407511-c68d-461b-9ebe-946b4d998b6f)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Creating volume 425dd1b5-9926-4307-b44e-7348ace4caf3 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:50 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-425dd1b5-9926-4307-b44e-7348ace4caf3 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:50 devstack quobyte-client[82625]: System call of process 95565 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:49:50 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=70, name=volume-425dd1b5-9926-4307-b44e-7348ace4caf3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-425dd1b5-9926-4307-b44e-7348ace4caf3 1073741824" returned: 0 in 0.522s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-425dd1b5-9926-4307-b44e-7348ace4caf3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-425dd1b5-9926-4307-b44e-7348ace4caf3" returned: 0 in 0.129s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] <== create_volume: return (754ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=69,cinder:INSERT=19,cinder:UPDATE=92,cinder:DELETE=7 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=95,cinder:SELECT=68,cinder:INSERT=19,cinder:DELETE=7 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b5bbc9-9e6e-43b6-b168-dd4d8c8827ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425dd1b5-9926-4307-b44e-7348ace4caf3', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f03e0e-08c4-4366-99cc-6fba8d2dc854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:51 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Flow 'volume_create_manager' (b7d42be4-de7e-4bf5-a6de-13f63e24efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a716a3f-b5ba-4725-b252-e7d4bdd50bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:51 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Volume volume-425dd1b5-9926-4307-b44e-7348ace4caf3 (425dd1b5-9926-4307-b44e-7348ace4caf3): created successfully Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f03e0e-08c4-4366-99cc-6fba8d2dc854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Flow 'volume_create_manager' (26aa7032-8979-40cc-8542-dd0a3f552055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:51 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d55bf1a1-222c-4dad-915f-423efb57e160 tempest-GroupsTest-483175920 None] Created volume successfully. Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a716a3f-b5ba-4725-b252-e7d4bdd50bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-455032846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85635270-8ee1-44d1-82b6-60f5342e304c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bf3646307b4742a9c89a77a1731f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:51Z,use_quota=True,user_id='ad8c01aa80bc46149902db341137bef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385c09d5-5e77-42c9-97e1-9a7120eaf676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385c09d5-5e77-42c9-97e1-9a7120eaf676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965d014f-c764-49c5-a336-2aadf81084ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965d014f-c764-49c5-a336-2aadf81084ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85635270-8ee1-44d1-82b6-60f5342e304c', 'volume_name': 'volume-85635270-8ee1-44d1-82b6-60f5342e304c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8594379b-a851-48a2-b278-38f223693725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8594379b-a851-48a2-b278-38f223693725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b36ea2-7183-4fa4-95e2-77c3f8975440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:51 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Volume 85635270-8ee1-44d1-82b6-60f5342e304c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85635270-8ee1-44d1-82b6-60f5342e304c', 'volume_size': 1} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-455032846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85635270-8ee1-44d1-82b6-60f5342e304c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bf3646307b4742a9c89a77a1731f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:51Z,use_quota=True,user_id='ad8c01aa80bc46149902db341137bef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Creating volume 85635270-8ee1-44d1-82b6-60f5342e304c {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:51 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-85635270-8ee1-44d1-82b6-60f5342e304c 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:51 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=71, name=volume-85635270-8ee1-44d1-82b6-60f5342e304c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-85635270-8ee1-44d1-82b6-60f5342e304c 1073741824" returned: 0 in 0.480s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-85635270-8ee1-44d1-82b6-60f5342e304c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-85635270-8ee1-44d1-82b6-60f5342e304c" returned: 0 in 0.133s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] <== create_volume: return (675ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b36ea2-7183-4fa4-95e2-77c3f8975440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85635270-8ee1-44d1-82b6-60f5342e304c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a5244b-a5ec-4213-87e4-41607578a9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:52 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8c4e10ba-b315-4cd5-88f0-38567795d36d tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:52 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Volume volume-85635270-8ee1-44d1-82b6-60f5342e304c (85635270-8ee1-44d1-82b6-60f5342e304c): created successfully Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a5244b-a5ec-4213-87e4-41607578a9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Flow 'volume_create_manager' (b7d42be4-de7e-4bf5-a6de-13f63e24efdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:52 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7183eb70-05f1-4792-aac2-e55d80d8a667 tempest-VolumesListAdminTestJSON-792894313 None] Created volume successfully. Sep 10 17:49:52 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8c4e10ba-b315-4cd5-88f0-38567795d36d tempest-GroupsTest-483175920 None] Update group completed successfully. Sep 10 17:49:53 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5159300e-67b2-4290-92ce-00ef4689740d tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:53 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Flow 'volume_create_manager' (377da409-89cb-4402-a56a-16c6dff58dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64efd3b2-7c74-4dbd-b943-e2e3e19378c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64efd3b2-7c74-4dbd-b943-e2e3e19378c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1781245157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc4a380-630a-4479-9621-b6856651e102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bf3646307b4742a9c89a77a1731f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:54Z,use_quota=True,user_id='ad8c01aa80bc46149902db341137bef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313a2622-efe4-47a2-9916-4b4e8cf45e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313a2622-efe4-47a2-9916-4b4e8cf45e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a135d6-b93b-41b1-b4eb-9536f0e7df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a135d6-b93b-41b1-b4eb-9536f0e7df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc4a380-630a-4479-9621-b6856651e102', 'volume_name': 'volume-9fc4a380-630a-4479-9621-b6856651e102', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb288b4-0bdb-46b7-8e08-edf0335d9a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb288b4-0bdb-46b7-8e08-edf0335d9a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197254db-a5bf-47cf-9693-3e3c6d0787fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:53 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Volume 9fc4a380-630a-4479-9621-b6856651e102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc4a380-630a-4479-9621-b6856651e102', 'volume_size': 1} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1781245157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc4a380-630a-4479-9621-b6856651e102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bf3646307b4742a9c89a77a1731f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:54Z,use_quota=True,user_id='ad8c01aa80bc46149902db341137bef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Creating volume 9fc4a380-630a-4479-9621-b6856651e102 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:53 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9fc4a380-630a-4479-9621-b6856651e102 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:54 devstack quobyte-client[82625]: System call of process 95575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:49:54 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=72, name=volume-9fc4a380-630a-4479-9621-b6856651e102, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5159300e-67b2-4290-92ce-00ef4689740d tempest-GroupsTest-483175920 None] Update group completed successfully. Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9fc4a380-630a-4479-9621-b6856651e102 1073741824" returned: 0 in 0.477s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9fc4a380-630a-4479-9621-b6856651e102 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9fc4a380-630a-4479-9621-b6856651e102" returned: 0 in 0.093s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] <== create_volume: return (642ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197254db-a5bf-47cf-9693-3e3c6d0787fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc4a380-630a-4479-9621-b6856651e102', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a53fda-914f-4918-ab69-d466ebffadc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:54 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Volume volume-9fc4a380-630a-4479-9621-b6856651e102 (9fc4a380-630a-4479-9621-b6856651e102): created successfully Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a53fda-914f-4918-ab69-d466ebffadc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Flow 'volume_create_manager' (377da409-89cb-4402-a56a-16c6dff58dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-036cfafb-6616-4531-90db-6745394b9b56 tempest-VolumesListAdminTestJSON-792894313 None] Created volume successfully. Sep 10 17:49:55 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Acquiring lock "cinder-quobyte-3c4cea7a-5266-491d-8628-49d32daccfd9" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Lock "cinder-quobyte-3c4cea7a-5266-491d-8628-49d32daccfd9" acquired by "delete_volume" :: waited 0.046s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:55 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b088995-6165-4e03-a350-564dcb699933]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c4cea7a-5266-491d-8628-49d32daccfd9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c4cea7a-5266-491d-8628-49d32daccfd9" returned: 0 in 0.597s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c4cea7a-5266-491d-8628-49d32daccfd9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3c4cea7a-5266-491d-8628-49d32daccfd9" returned: 0 in 0.104s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Lock "cinder-quobyte-3c4cea7a-5266-491d-8628-49d32daccfd9" released by "delete_volume" :: held 0.868s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Acquiring lock "cinder-quobyte-425dd1b5-9926-4307-b44e-7348ace4caf3" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Lock "cinder-quobyte-425dd1b5-9926-4307-b44e-7348ace4caf3" acquired by "delete_volume" :: waited 0.046s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:56 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[08401751-693d-4f58-944c-3a30e054e2c5]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-425dd1b5-9926-4307-b44e-7348ace4caf3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-425dd1b5-9926-4307-b44e-7348ace4caf3" returned: 0 in 0.801s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-425dd1b5-9926-4307-b44e-7348ace4caf3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Flow 'volume_create_manager' (1903c847-2b70-406c-996b-3d9720dbe808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b8fe65-91e4-45e1-a915-29945f731125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-425dd1b5-9926-4307-b44e-7348ace4caf3" returned: 0 in 0.422s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b8fe65-91e4-45e1-a915-29945f731125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dffbe15-5f9e-44dc-afef-aeb022df00be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de22687342f349b58d29181c8ce7b7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:57Z,use_quota=True,user_id='3bad3a906dfe4efda6784fc4452bf1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450a2096-0c48-45dd-981f-a6fa235f50da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450a2096-0c48-45dd-981f-a6fa235f50da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003b2565-1afd-40be-be1f-8070748061db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003b2565-1afd-40be-be1f-8070748061db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dffbe15-5f9e-44dc-afef-aeb022df00be', 'volume_name': 'volume-4dffbe15-5f9e-44dc-afef-aeb022df00be', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2825c835-caae-4f85-9d6f-5c6ff49ff23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2825c835-caae-4f85-9d6f-5c6ff49ff23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e7f9ec-4452-4edf-b9fa-7bfadd61649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Volume 4dffbe15-5f9e-44dc-afef-aeb022df00be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dffbe15-5f9e-44dc-afef-aeb022df00be', 'volume_size': 1} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dffbe15-5f9e-44dc-afef-aeb022df00be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de22687342f349b58d29181c8ce7b7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:57Z,use_quota=True,user_id='3bad3a906dfe4efda6784fc4452bf1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Creating volume 4dffbe15-5f9e-44dc-afef-aeb022df00be {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:49:57 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:49:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4dffbe15-5f9e-44dc-afef-aeb022df00be 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:58 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=73, name=volume-4dffbe15-5f9e-44dc-afef-aeb022df00be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Lock "cinder-quobyte-425dd1b5-9926-4307-b44e-7348ace4caf3" released by "delete_volume" :: held 1.569s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4dffbe15-5f9e-44dc-afef-aeb022df00be 1073741824" returned: 0 in 0.546s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4dffbe15-5f9e-44dc-afef-aeb022df00be {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4dffbe15-5f9e-44dc-afef-aeb022df00be" returned: 0 in 0.197s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] <== create_volume: return (791ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e7f9ec-4452-4edf-b9fa-7bfadd61649b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dffbe15-5f9e-44dc-afef-aeb022df00be', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48af037e-b610-402b-9768-9bf3555b9880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:49:58 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Volume volume-4dffbe15-5f9e-44dc-afef-aeb022df00be (4dffbe15-5f9e-44dc-afef-aeb022df00be): created successfully Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48af037e-b610-402b-9768-9bf3555b9880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:49:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Flow 'volume_create_manager' (1903c847-2b70-406c-996b-3d9720dbe808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Created reservations ['9ea233c4-7753-4ff3-acc4-c8d17491ddd4'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:59 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4206aa97-e84e-41a9-a6f8-5cbd0f1c7ec9 tempest-VolumesListAdminTestJSON-547735905 None] Created volume successfully. Sep 10 17:49:59 devstack cinder-volume[82609]: WARNING cinder.quota [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-720816706 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-720816706, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:49:59 devstack cinder-volume[82609]: WARNING cinder.quota [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-720816706 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-720816706, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Created reservations ['017d73a2-0f2f-40e1-86bc-7647bb41d218', '869bf63f-6496-46a5-9c62-01d910461a55', 'a453600b-9df1-4851-91de-07699dabde46', '8bf3b327-7c2e-4cf5-a4d9-dc568b8eb808'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Created reservations ['cafa5c5e-d990-4e5e-a017-e6bee439c90d', '140e6f80-1297-493c-be5c-f41a46a3b6ab', '04ad0f11-1d2c-478c-95df-6f50fbcb3f45', 'bb8f4b5c-c0a3-417f-885d-579755838ef6'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Acquiring lock "cinder-4dffbe15-5f9e-44dc-afef-aeb022df00be-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Lock "cinder-4dffbe15-5f9e-44dc-afef-aeb022df00be-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:59 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Acquiring lock "cinder-quobyte-4dffbe15-5f9e-44dc-afef-aeb022df00be" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Lock "cinder-quobyte-4dffbe15-5f9e-44dc-afef-aeb022df00be" acquired by "delete_volume" :: waited 0.014s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[20753304-0842-430e-9c1b-72cb9d612a44]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:49:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4dffbe15-5f9e-44dc-afef-aeb022df00be {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "cinder-9fc4a380-630a-4479-9621-b6856651e102-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-9fc4a380-630a-4479-9621-b6856651e102-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4dffbe15-5f9e-44dc-afef-aeb022df00be" returned: 0 in 0.608s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4dffbe15-5f9e-44dc-afef-aeb022df00be {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4dffbe15-5f9e-44dc-afef-aeb022df00be" returned: 0 in 0.084s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Lock "cinder-quobyte-4dffbe15-5f9e-44dc-afef-aeb022df00be" released by "delete_volume" :: held 0.830s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Created reservations ['2b67cdbe-368d-454a-bc3f-1da25bcc1724', '5bbfca52-bc62-4eff-8e17-be2f7b535ef3', 'e2f3e17a-aebd-47af-a2b1-0403cf152cd9', 'dd1f8b25-ec95-4257-9d05-656d5b1d8eab'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:50:02 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "cinder-quobyte-9fc4a380-630a-4479-9621-b6856651e102" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-quobyte-9fc4a380-630a-4479-9621-b6856651e102" acquired by "delete_volume" :: waited 0.021s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[49156788-2675-4d39-bacd-9239da32f0c8]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9fc4a380-630a-4479-9621-b6856651e102 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9fc4a380-630a-4479-9621-b6856651e102" returned: 0 in 0.704s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9fc4a380-630a-4479-9621-b6856651e102 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.365s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:50:03 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5fa99aa7-e788-400f-a1a1-e86b1c1287d6 tempest-GroupsTest-483175920 None] Delete group completed successfully. Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-9fc4a380-630a-4479-9621-b6856651e102" returned: 0 in 0.408s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-quobyte-9fc4a380-630a-4479-9621-b6856651e102" released by "delete_volume" :: held 1.208s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.200s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:03 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:50:03 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Deleted volume successfully. Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Created reservations ['bc0c712d-a09b-4252-8a4b-02d0cef4f1d0', '4b4e5ae3-af6e-4d8b-8a2f-5842c0e526bc', '65b333b9-874b-48a1-8f62-89d3e2289e4c', '4fdac075-f9c3-47c2-bfb3-cbba4dc425b8'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3c23e1a0-0775-4448-a003-4aa196a77f8d tempest-VolumesListAdminTestJSON-547735905 None] Lock "cinder-4dffbe15-5f9e-44dc-afef-aeb022df00be-delete_volume" released by "delete_volume" :: held 4.518s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.133s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:04 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:50:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Deleted volume successfully. Sep 10 17:50:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "cinder-85635270-8ee1-44d1-82b6-60f5342e304c-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-85635270-8ee1-44d1-82b6-60f5342e304c-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4caf05ef-1b9a-4cf1-8a1f-1753e51a18ee tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-9fc4a380-630a-4479-9621-b6856651e102-delete_volume" released by "delete_volume" :: held 4.894s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:05 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "cinder-quobyte-85635270-8ee1-44d1-82b6-60f5342e304c" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-quobyte-85635270-8ee1-44d1-82b6-60f5342e304c" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:05 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b5b9c7-489d-4973-a290-50a0861abc68]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-85635270-8ee1-44d1-82b6-60f5342e304c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-85635270-8ee1-44d1-82b6-60f5342e304c" returned: 0 in 0.527s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-85635270-8ee1-44d1-82b6-60f5342e304c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-85635270-8ee1-44d1-82b6-60f5342e304c" returned: 0 in 0.086s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-quobyte-85635270-8ee1-44d1-82b6-60f5342e304c" released by "delete_volume" :: held 0.765s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Created reservations ['67fce186-cc2c-4e12-a3a7-2d2042b8d544', 'e150bc46-a32d-4b41-9afb-ab3795ce02ef', '6641173e-206d-4e4f-8444-ab3231a984a4', 'f9e382b0-5bca-47b1-b765-ad1eba71de92'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.236s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:08 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:50:09 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Deleted volume successfully. Sep 10 17:50:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-34e2572b-872d-4851-93f2-a3ae37684ca1 tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-85635270-8ee1-44d1-82b6-60f5342e304c-delete_volume" released by "delete_volume" :: held 4.055s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "cinder-5c8934c0-99d2-409e-9338-6d6b4a31cd49-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-5c8934c0-99d2-409e-9338-6d6b4a31cd49-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:10 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "cinder-quobyte-5c8934c0-99d2-409e-9338-6d6b4a31cd49" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-quobyte-5c8934c0-99d2-409e-9338-6d6b4a31cd49" acquired by "delete_volume" :: waited 0.019s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:10 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fea9a0-912f-4a00-b0a6-822dbf58ecf8]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49" returned: 0 in 0.781s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-5c8934c0-99d2-409e-9338-6d6b4a31cd49" returned: 0 in 0.276s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-quobyte-5c8934c0-99d2-409e-9338-6d6b4a31cd49" released by "delete_volume" :: held 1.310s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Created reservations ['d410b029-b26a-45bd-bd72-2494acac5fbf', '832c826a-636e-438e-9bf9-baf37e48b685', '9c6b432c-ddae-4ff9-a13e-224247980fdc', 'be194e7c-2776-46d0-a00a-8df0f98bdcae'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.145s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:12 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:50:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Deleted volume successfully. Sep 10 17:50:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d72e19e-ee73-4064-a91b-696dd712af0c tempest-VolumesListAdminTestJSON-792894313 None] Lock "cinder-5c8934c0-99d2-409e-9338-6d6b4a31cd49-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-edd8fe39-b71b-40d6-8688-d898daf29176 tempest-GroupsV320Test-1579901162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-edd8fe39-b71b-40d6-8688-d898daf29176 tempest-GroupsV320Test-1579901162 None] Group tempest-GroupsV320Test-Group-1908035600: creating Sep 10 17:50:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-edd8fe39-b71b-40d6-8688-d898daf29176 tempest-GroupsV320Test-1579901162 None] Group tempest-GroupsV320Test-Group-1908035600: created successfully Sep 10 17:50:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-edd8fe39-b71b-40d6-8688-d898daf29176 tempest-GroupsV320Test-1579901162 None] Create group completed successfully. Sep 10 17:50:17 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Created reservations ['83db4f0a-4316-4aaa-9cc9-264f7cfcd453'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.146s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:17 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:50:17 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-bf270c53-9d22-4d93-8ad7-58e73e7f259c tempest-GroupsV320Test-1579901162 None] Delete group completed successfully. Sep 10 17:50:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:19 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:50:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Flow 'volume_create_manager' (113054e4-3a4a-4513-a4cb-d1232ad2f89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:50:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e079c-cab2-4cb5-bdda-b7f0250487bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e079c-cab2-4cb5-bdda-b7f0250487bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2073576573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc92f397-53d3-483a-a43f-9a33da49f1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0722349353d047859465645c71aa424a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:50:19Z,use_quota=True,user_id='25e3e9dbea8249b4b1e045e223ce2b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c6448d-909b-4765-8a9a-d0d5e5ae3ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c6448d-909b-4765-8a9a-d0d5e5ae3ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f21be4-73b3-40ae-ac59-3fc1864bf229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f21be4-73b3-40ae-ac59-3fc1864bf229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc92f397-53d3-483a-a43f-9a33da49f1f3', 'volume_name': 'volume-bc92f397-53d3-483a-a43f-9a33da49f1f3', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b288ce9-119f-41b6-9375-cc474eda8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b288ce9-119f-41b6-9375-cc474eda8be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3412ea-367b-4516-9f6c-8130acbe51d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:20 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Volume bc92f397-53d3-483a-a43f-9a33da49f1f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc92f397-53d3-483a-a43f-9a33da49f1f3', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 17:50:20 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Cloning bc92f397-53d3-483a-a43f-9a33da49f1f3 from image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 at location (None, None). {{(pid=82609) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 17:50:21 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 17:50:21 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Image download 20.69 MB at 20.69 MB/s Sep 10 17:50:21 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0ba64a-4137-4c1c-81d5-6dda918dbe01]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:24 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD Sep 10 17:50:24 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:50:27 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD" returned: 0 in 5.748s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Temporary image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 is fetched for user 25e3e9dbea8249b4b1e045e223ce2b84. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.255s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b6bf84-9a40-45a0-aad4-cd84d2cf77c6]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:28 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD Sep 10 17:50:28 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:50:30 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD" returned: 0 in 2.267s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2073576573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc92f397-53d3-483a-a43f-9a33da49f1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0722349353d047859465645c71aa424a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:50:19Z,use_quota=True,user_id='25e3e9dbea8249b4b1e045e223ce2b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Creating volume bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:50:30 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:30 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=74, name=volume-bc92f397-53d3-483a-a43f-9a33da49f1f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 1073741824" returned: 0 in 0.375s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3" returned: 0 in 0.220s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] <== create_volume: return (719ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:50:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:32 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Attempting download of 36810fdd-7157-4a06-a4dd-33f26a5e8f64 ((None, None)) to volume bc92f397-53d3-483a-a43f-9a33da49f1f3. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 17:50:32 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6ce03-5a6f-4892-b65b-273b02a73ae9]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_vyt58jri {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_vyt58jri" returned: 0 in 0.492s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_vyt58jri {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_vyt58jri" returned: 1 in 0.553s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_vyt58jri' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:50:33 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[89577558-0104-4689-9c49-52e72f9f1196]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD" returned: 0 in 0.543s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:34 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] 36810fdd-7157-4a06-a4dd-33f26a5e8f64 was qcow2, converting to raw {{(pid=82609) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 17:50:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:34 devstack quobyte-client[82625]: System call of process 95649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:50:34 devstack quobyte-client[82625]: System call of process 95649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:50:34 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=74, name=volume-bc92f397-53d3-483a-a43f-9a33da49f1f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:50:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3" returned: 0 in 1.677s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:36 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_bxvvkcs_devstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:50:36 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Converted 112.00 MB image at 61.78 MB/s Sep 10 17:50:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 1G" returned: 0 in 0.218s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:36 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa13a9b-41bf-4417-8b64-da2485f986be]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3" returned: 0 in 0.512s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3" returned: 1 in 0.504s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Downloaded image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 ((None, None)) to volume bc92f397-53d3-483a-a43f-9a33da49f1f3 successfully. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Temporary image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 for user 25e3e9dbea8249b4b1e045e223ce2b84 is deleted. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Marking volume bc92f397-53d3-483a-a43f-9a33da49f1f3 as bootable. {{(pid=82609) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=65,cinder:SELECT=48,cinder:DELETE=5,cinder:INSERT=15 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Copying metadata from image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 to bc92f397-53d3-483a-a43f-9a33da49f1f3. {{(pid=82609) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 17:50:37 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Creating volume glance metadata for volume bc92f397-53d3-483a-a43f-9a33da49f1f3 backed by image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82609) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 17:50:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3412ea-367b-4516-9f6c-8130acbe51d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc92f397-53d3-483a-a43f-9a33da49f1f3', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9aa5e6-a441-41c8-856d-6c74af2cde1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:38 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Volume volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 (bc92f397-53d3-483a-a43f-9a33da49f1f3): created successfully Sep 10 17:50:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9aa5e6-a441-41c8-856d-6c74af2cde1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Flow 'volume_create_manager' (113054e4-3a4a-4513-a4cb-d1232ad2f89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:50:38 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0785338c-ccc3-4894-9ee7-611236dd51c5 tempest-VolumesImageMetadata-1893304358 None] Created volume successfully. Sep 10 17:50:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Acquiring lock "cinder-bc92f397-53d3-483a-a43f-9a33da49f1f3-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Lock "cinder-bc92f397-53d3-483a-a43f-9a33da49f1f3-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Acquiring lock "cinder-quobyte-bc92f397-53d3-483a-a43f-9a33da49f1f3" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Lock "cinder-quobyte-bc92f397-53d3-483a-a43f-9a33da49f1f3" acquired by "delete_volume" :: waited 0.031s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:40 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a5a92-a94b-4cd2-a5c6-64715267acd5]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3" returned: 0 in 1.662s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3" returned: 1 in 0.800s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:50:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-bc92f397-53d3-483a-a43f-9a33da49f1f3" returned: 0 in 0.134s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Lock "cinder-quobyte-bc92f397-53d3-483a-a43f-9a33da49f1f3" released by "delete_volume" :: held 2.976s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Created reservations ['9be9a2b9-8555-4871-8135-78886b14d372', '0be853d0-53a3-4005-9114-dc8a9f8fff0f', '844d26f9-c630-4fca-b782-bf84be8a901b', 'f64e95e6-a5d9-4b3d-82be-bb232170a51a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.187s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:44 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:50:44 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Deleted volume successfully. Sep 10 17:50:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-85a88e18-6a12-4535-9e79-85edb596594b tempest-VolumesImageMetadata-1893304358 None] Lock "cinder-bc92f397-53d3-483a-a43f-9a33da49f1f3-delete_volume" released by "delete_volume" :: held 4.466s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:50:49 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Flow 'volume_create_manager' (5fa00260-2c54-419a-a8f1-62b3b1a1cb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5d818e-7151-4840-ae73-9d7de0ca2eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5d818e-7151-4840-ae73-9d7de0ca2eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2013628987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f6e467-5fe9-4665-8285-29f3295218ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9467d045bc4215b7658d686d6de49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:50:49Z,use_quota=True,user_id='9414f8f27ce549f9badf6a09fdc2457b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6c4e7f-d35e-48bb-a597-b236f32ef014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6c4e7f-d35e-48bb-a597-b236f32ef014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66c4ec4-349a-4e05-ad12-b154ebe2addd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66c4ec4-349a-4e05-ad12-b154ebe2addd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f6e467-5fe9-4665-8285-29f3295218ba', 'volume_name': 'volume-55f6e467-5fe9-4665-8285-29f3295218ba', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6ef785-7b27-486d-87b1-30252cd7a2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6ef785-7b27-486d-87b1-30252cd7a2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c394b9-6621-4c97-992d-542c1638bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:49 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Volume 55f6e467-5fe9-4665-8285-29f3295218ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f6e467-5fe9-4665-8285-29f3295218ba', 'volume_size': 1} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2013628987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f6e467-5fe9-4665-8285-29f3295218ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9467d045bc4215b7658d686d6de49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:50:49Z,use_quota=True,user_id='9414f8f27ce549f9badf6a09fdc2457b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Creating volume 55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:50:49 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:49 devstack quobyte-client[82625]: System call of process 95712 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:50:49 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=75, name=volume-55f6e467-5fe9-4665-8285-29f3295218ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:50:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba 1073741824" returned: 0 in 0.403s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba" returned: 0 in 0.145s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:50:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c394b9-6621-4c97-992d-542c1638bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f6e467-5fe9-4665-8285-29f3295218ba', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa171ee-b1c4-4a15-8714-43c2f4c6e797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:50 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Volume volume-55f6e467-5fe9-4665-8285-29f3295218ba (55f6e467-5fe9-4665-8285-29f3295218ba): created successfully Sep 10 17:50:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa171ee-b1c4-4a15-8714-43c2f4c6e797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Flow 'volume_create_manager' (5fa00260-2c54-419a-a8f1-62b3b1a1cb32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:50:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1280d531-41e1-4695-b67e-7599fa60f992 tempest-VolumesDeleteCascade-2049669152 None] Created volume successfully. Sep 10 17:50:51 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Creating offline snapshot 68a5f7bc-a21d-4546-8bed-07be4d714c70 of volume 55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:50:51 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e76e26e-ea92-4ac3-8a6f-e22dfa9199c4]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba" returned: 0 in 0.536s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:52 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=76, name=volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:50:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 1G" returned: 0 in 0.309s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img rebase -u -b volume-55f6e467-5fe9-4665-8285-29f3295218ba -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img rebase -u -b volume-55f6e467-5fe9-4665-8285-29f3295218ba -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70" returned: 0 in 0.187s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70" returned: 0 in 0.129s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70" returned: 0 in 0.114s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.info" returned: 0 in 0.114s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.info" returned: 0 in 0.157s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:54 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=80,cinder:SELECT=71,cinder:DELETE=5,cinder:INSERT=28 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:50:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-28b48fbe-684e-4281-8e76-846a2f55c16f tempest-VolumesDeleteCascade-2049669152 None] Create snapshot completed successfully Sep 10 17:50:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:54 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:50:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Flow 'volume_create_manager' (fb8fd707-b77b-4b17-ab67-2ab03c16e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:50:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac4a8c3-148f-4c37-9d96-23ceffa84356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac4a8c3-148f-4c37-9d96-23ceffa84356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1615897836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3338acc-ee94-4c9b-9f41-deb3121f3c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5a0a82271349f2923e1345b57e9655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:50:55Z,use_quota=True,user_id='87c6a1227bc4458e80564a66fface39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe3a758-f017-410d-9af7-f8df2ec35df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe3a758-f017-410d-9af7-f8df2ec35df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf43a2c-aeb7-473f-8996-fecf01c991c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf43a2c-aeb7-473f-8996-fecf01c991c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3338acc-ee94-4c9b-9f41-deb3121f3c0b', 'volume_name': 'volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d8cb92-68de-44d7-9923-2dd22dd9c27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d8cb92-68de-44d7-9923-2dd22dd9c27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ab15ea-f72f-447e-be43-0d9b467f76a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:55 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Volume c3338acc-ee94-4c9b-9f41-deb3121f3c0b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Cloning c3338acc-ee94-4c9b-9f41-deb3121f3c0b from image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 at location (None, None). {{(pid=82609) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 17:50:55 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Creating offline snapshot 4ed0ce3c-8a7f-4928-8af1-983d6908e970 of volume 55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0e5e6-e7b7-4c72-8cdc-45b941c62d76]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70" returned: 0 in 0.520s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55f6e467-5fe9-4665-8285-29f3295218ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:50:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:56 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 17:50:56 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Image download 20.69 MB at 20.69 MB/s Sep 10 17:50:56 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=78, name=volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:50:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 1G" returned: 0 in 0.367s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img rebase -u -b volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:56 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfe227a-e327-4099-b841-55f5f498da7b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img rebase -u -b volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970" returned: 0 in 0.674s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:50:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:57 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD Sep 10 17:50:57 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:50:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Flow 'volume_create_manager' (8ad3260b-8021-4ab5-8122-ba8c4ab9f3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a31bc7-5eee-4262-8903-a0f9ca5e4462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a31bc7-5eee-4262-8903-a0f9ca5e4462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1534633434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dca535-b386-4fc7-a4af-966f968837ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f700f9044bb4cb583bd09855d18a267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:50:57Z,use_quota=True,user_id='7ac40cf6af584b548f5f4a14658a520a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67a851c-8a73-4c12-b1f2-35544fe3a662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67a851c-8a73-4c12-b1f2-35544fe3a662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a89cb3-ce59-4b0f-a14f-6d42cdfd6ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a89cb3-ce59-4b0f-a14f-6d42cdfd6ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70dca535-b386-4fc7-a4af-966f968837ef', 'volume_name': 'volume-70dca535-b386-4fc7-a4af-966f968837ef', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766bc216-6796-4393-886f-1ba74877dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766bc216-6796-4393-886f-1ba74877dd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8e3c7f-c7bd-4edc-96d1-33b9fab38bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Volume 70dca535-b386-4fc7-a4af-966f968837ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70dca535-b386-4fc7-a4af-966f968837ef', 'volume_size': 1} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970" returned: 0 in 0.590s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970" returned: 0 in 0.127s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1534633434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dca535-b386-4fc7-a4af-966f968837ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f700f9044bb4cb583bd09855d18a267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:50:57Z,use_quota=True,user_id='7ac40cf6af584b548f5f4a14658a520a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Creating volume 70dca535-b386-4fc7-a4af-966f968837ef {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:50:58 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-70dca535-b386-4fc7-a4af-966f968837ef 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:58 devstack quobyte-client[82625]: System call of process 95743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:50:58 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=79, name=volume-70dca535-b386-4fc7-a4af-966f968837ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:50:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-dfd2a0ea-6556-422b-b57e-7e812e46e956 tempest-VolumesDeleteCascade-2049669152 None] Create snapshot completed successfully Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-70dca535-b386-4fc7-a4af-966f968837ef 1073741824" returned: 0 in 0.490s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-70dca535-b386-4fc7-a4af-966f968837ef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-70dca535-b386-4fc7-a4af-966f968837ef" returned: 0 in 0.333s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] <== create_volume: return (886ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8e3c7f-c7bd-4edc-96d1-33b9fab38bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70dca535-b386-4fc7-a4af-966f968837ef', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aefc7ee-0f16-4f79-a97c-02db6b181b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:50:59 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Volume volume-70dca535-b386-4fc7-a4af-966f968837ef (70dca535-b386-4fc7-a4af-966f968837ef): created successfully Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aefc7ee-0f16-4f79-a97c-02db6b181b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:50:59 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Flow 'volume_create_manager' (8ad3260b-8021-4ab5-8122-ba8c4ab9f3b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD" returned: 0 in 3.020s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Temporary image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 is fetched for user 87c6a1227bc4458e80564a66fface39c. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 17:50:59 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-be8b0d64-5f26-4fa9-88f2-817e97d8c879 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Created volume successfully. Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-55f6e467-5fe9-4665-8285-29f3295218ba-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-55f6e467-5fe9-4665-8285-29f3295218ba-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab571643-9ac8-41b4-98e2-79007867e0e0]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:50:59 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:50:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Performing cascade delete. {{(pid=82609) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-4ed0ce3c-8a7f-4928-8af1-983d6908e970-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-4ed0ce3c-8a7f-4928-8af1-983d6908e970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.201s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:00 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-4ed0ce3c-8a7f-4928-8af1-983d6908e970" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-4ed0ce3c-8a7f-4928-8af1-983d6908e970" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Deleting offline snapshot 4ed0ce3c-8a7f-4928-8af1-983d6908e970 of volume 55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] snapshot_file for this snap is: volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc5fa38-fe85-400b-b2b0-4895f4b9d410]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:00 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD Sep 10 17:51:00 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:51:01 devstack quobyte-client[82625]: System call of process 95752 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970" returned: 0 in 0.825s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55f6e467-5fe9-4665-8285-29f3295218ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:51:01 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0990626-2186-43d1-94f4-224f20878203]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Acquiring lock "cinder-70dca535-b386-4fc7-a4af-966f968837ef-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "cinder-70dca535-b386-4fc7-a4af-966f968837ef-delete_volume" acquired by "delete_volume" :: waited 0.142s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:02 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Acquiring lock "cinder-quobyte-70dca535-b386-4fc7-a4af-966f968837ef" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "cinder-quobyte-70dca535-b386-4fc7-a4af-966f968837ef" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[44151d13-04ea-4b5b-a335-1bd214502a72]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-70dca535-b386-4fc7-a4af-966f968837ef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:02 devstack quobyte-client[82625]: System call of process 95756 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70" returned: 0 in 0.973s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55f6e467-5fe9-4665-8285-29f3295218ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:51:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:02 devstack quobyte-client[82625]: System call of process 95764 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:03 devstack quobyte-client[82625]: System call of process 95759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970" returned: 0 in 0.614s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-70dca535-b386-4fc7-a4af-966f968837ef" returned: 0 in 0.979s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:03 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-70dca535-b386-4fc7-a4af-966f968837ef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD" returned: 0 in 3.610s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1615897836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3338acc-ee94-4c9b-9f41-deb3121f3c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5a0a82271349f2923e1345b57e9655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:50:55Z,use_quota=True,user_id='87c6a1227bc4458e80564a66fface39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Creating volume c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:51:03 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.4ed0ce3c-8a7f-4928-8af1-983d6908e970" returned: 0 in 0.413s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:03 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=80, name=volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-70dca535-b386-4fc7-a4af-966f968837ef" returned: 0 in 0.346s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-4ed0ce3c-8a7f-4928-8af1-983d6908e970" released by "_delete_snapshot" :: held 3.260s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "cinder-quobyte-70dca535-b386-4fc7-a4af-966f968837ef" released by "delete_volume" :: held 1.488s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" released by "delete_snapshot" :: held 3.425s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b 1073741824" returned: 0 in 0.442s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 0 in 0.404s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Created reservations ['19129b09-76e7-4905-90d3-637de7e36232', '4e2abb36-047d-44ae-9f1c-080044090368', '935c4f20-8350-47fc-b426-9c7cdb09f27c', '1137be7b-1553-484b-baec-d39892dd407f'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Attempting download of 36810fdd-7157-4a06-a4dd-33f26a5e8f64 ((None, None)) to volume c3338acc-ee94-4c9b-9f41-deb3121f3c0b. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Created reservations ['d9e488b7-166f-4efa-a623-0ebdb21b807d', 'b12edf78-4ea0-452f-beec-8b86f9766e9f', '99a28281-b4b0-4c4d-8887-ed7aed436482', '20c9c930-6310-4f34-b7b2-4b25d846bbaf'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da88cc-5ff4-48a0-a78e-65671e2b459a]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_4njooeqc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.653s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:51:05 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Delete snapshot completed successfully. Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-4ed0ce3c-8a7f-4928-8af1-983d6908e970-delete_snapshot" released by "delete_snapshot" :: held 5.328s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-68a5f7bc-a21d-4546-8bed-07be4d714c70-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:05 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Deleted volume successfully. Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-68a5f7bc-a21d-4546-8bed-07be4d714c70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:05 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_4njooeqc" returned: 0 in 0.729s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_4njooeqc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-766b09d7-bb7d-418b-82b3-8d9d370dc911 tempest-VolumeQuotasNegativeTestJSON-371338304 None] Lock "cinder-70dca535-b386-4fc7-a4af-966f968837ef-delete_volume" released by "delete_volume" :: held 3.881s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" acquired by "delete_snapshot" :: waited 0.249s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-68a5f7bc-a21d-4546-8bed-07be4d714c70" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-68a5f7bc-a21d-4546-8bed-07be4d714c70" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Deleting offline snapshot 68a5f7bc-a21d-4546-8bed-07be4d714c70 of volume 55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] snapshot_file for this snap is: volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93ace56-13ee-488b-9a63-e9f36196f89d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_4njooeqc" returned: 1 in 0.586s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_4njooeqc' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[305d225f-5952-4d2b-a4f0-023ca9ec9afb]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:06 devstack quobyte-client[82625]: System call of process 95779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70" returned: 0 in 0.582s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55f6e467-5fe9-4665-8285-29f3295218ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3cba59-fbb0-4cf8-93c5-e000cd2d5377]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD" returned: 0 in 0.580s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:07 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] 36810fdd-7157-4a06-a4dd-33f26a5e8f64 was qcow2, converting to raw {{(pid=82609) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 17:51:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:07 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=80, name=volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:51:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba" returned: 0 in 0.611s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:07 devstack quobyte-client[82625]: System call of process 95797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70" returned: 0 in 0.371s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba.68a5f7bc-a21d-4546-8bed-07be4d714c70" returned: 0 in 0.162s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-68a5f7bc-a21d-4546-8bed-07be4d714c70" released by "_delete_snapshot" :: held 2.249s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" released by "delete_snapshot" :: held 2.304s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 0 in 1.459s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:08 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_m2h45m42devstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:51:08 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Converted 112.00 MB image at 76.47 MB/s Sep 10 17:51:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b 1G" returned: 0 in 0.476s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc80d23-4235-4449-a25a-015443b3d82e]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:09 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Created reservations ['c7d3136f-27a2-4303-86dd-8a47454c48df', '092ba9df-8e7c-4962-93cc-567241c09ec1', 'e4c8f67c-bbe4-46db-ba3d-915ab596bb57', '0c637aae-b434-4a89-b453-4673158e9282'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:51:10 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Delete snapshot completed successfully. Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 0 in 0.760s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-68a5f7bc-a21d-4546-8bed-07be4d714c70-delete_snapshot" released by "delete_snapshot" :: held 4.493s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Snapshots deleted, issuing volume delete {{(pid=82609) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" acquired by "delete_volume" :: waited 0.115s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d034f-64a3-476c-8d0d-382d165cc87f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 1 in 0.716s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Downloaded image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 ((None, None)) to volume c3338acc-ee94-4c9b-9f41-deb3121f3c0b successfully. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Temporary image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 for user 87c6a1227bc4458e80564a66fface39c is deleted. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Marking volume c3338acc-ee94-4c9b-9f41-deb3121f3c0b as bootable. {{(pid=82609) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Copying metadata from image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 to c3338acc-ee94-4c9b-9f41-deb3121f3c0b. {{(pid=82609) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Creating volume glance metadata for volume c3338acc-ee94-4c9b-9f41-deb3121f3c0b backed by image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82609) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba" returned: 0 in 0.895s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ab15ea-f72f-447e-be43-0d9b467f76a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f37d8f-f42e-4ae9-a6e6-f701bf25edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-55f6e467-5fe9-4665-8285-29f3295218ba" returned: 0 in 0.343s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-55f6e467-5fe9-4665-8285-29f3295218ba" released by "delete_volume" :: held 1.369s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:11 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Volume volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b (c3338acc-ee94-4c9b-9f41-deb3121f3c0b): created successfully Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f37d8f-f42e-4ae9-a6e6-f701bf25edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Flow 'volume_create_manager' (fb8fd707-b77b-4b17-ab67-2ab03c16e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:51:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-16336998-d6e6-4482-aa42-50618aaf212a tempest-TestShelveInstance-798093805 None] Created volume successfully. Sep 10 17:51:12 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Created reservations ['294bae50-2be9-4948-94d1-5f02f65b8771', 'a6ee5920-c87e-4e9d-93e5-4297c4f33d0d', '4fd71c01-8a25-429a-9a88-8f7d03f8d1e8', 'bc9f0301-f419-4dca-9a1c-901dd6be7f22'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:51:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.138s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:13 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:51:13 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Deleted volume successfully. Sep 10 17:51:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-962b0362-a49b-4646-99c1-1c53d2bb2a04 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-55f6e467-5fe9-4665-8285-29f3295218ba-delete_volume" released by "delete_volume" :: held 14.374s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Flow 'volume_create_manager' (faa66c51-075a-42b8-b8a2-f3414f888bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bca8a3-6d2b-4ac3-9c4d-4a8c4a502bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bca8a3-6d2b-4ac3-9c4d-4a8c4a502bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-53364503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f4c4f6-532a-438a-b9c8-71a30750e5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9467d045bc4215b7658d686d6de49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:51:15Z,use_quota=True,user_id='9414f8f27ce549f9badf6a09fdc2457b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8aa98b-1df0-4057-bbdb-621ae913de7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8aa98b-1df0-4057-bbdb-621ae913de7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c6e284-bca3-4e30-99c7-5965e8094adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c6e284-bca3-4e30-99c7-5965e8094adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f4c4f6-532a-438a-b9c8-71a30750e5d5', 'volume_name': 'volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13461925-04ca-4c62-b600-32480095df22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13461925-04ca-4c62-b600-32480095df22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553ddcf4-b390-4bcf-92e5-5104da98dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:15 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Volume 15f4c4f6-532a-438a-b9c8-71a30750e5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5', 'volume_size': 1} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-53364503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f4c4f6-532a-438a-b9c8-71a30750e5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9467d045bc4215b7658d686d6de49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:51:15Z,use_quota=True,user_id='9414f8f27ce549f9badf6a09fdc2457b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Creating volume 15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:51:15 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:51:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:16 devstack quobyte-client[82625]: System call of process 95822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:16 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=81, name=volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:51:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 1073741824" returned: 0 in 0.665s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5" returned: 0 in 0.252s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] <== create_volume: return (958ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:51:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:16 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:16 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:51:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Flow 'volume_create_manager' (0b214fb5-4fee-4588-ae44-d209e19b46ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12ec109-9a75-4f59-820c-a02d8c50b3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553ddcf4-b390-4bcf-92e5-5104da98dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fd8cbb-98cf-4d84-b98a-40e6a0e0d8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12ec109-9a75-4f59-820c-a02d8c50b3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1120227839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b6b8d5-1f11-4272-b541-58e413cc3360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5109ee3d654958a8b033d0cb25097c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:51:16Z,use_quota=True,user_id='7a65c72f7e1044738d9b6d0c70c38d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(002f150a-7204-476d-afcb-4d8885ee88ad),volume_type_id=002f150a-7204-476d-afcb-4d8885ee88ad)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b366226-cd3e-45fb-a9b9-f87dfde455b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b366226-cd3e-45fb-a9b9-f87dfde455b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b092b3-da3a-4ef9-855a-eb5285b4b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b092b3-da3a-4ef9-855a-eb5285b4b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b6b8d5-1f11-4272-b541-58e413cc3360', 'volume_name': 'volume-83b6b8d5-1f11-4272-b541-58e413cc3360', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba9168a-d18d-4e2b-9cd5-243f1bc18c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba9168a-d18d-4e2b-9cd5-243f1bc18c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aedf37d-300e-4743-b389-7dc051c55e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:17 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Volume 83b6b8d5-1f11-4272-b541-58e413cc3360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b6b8d5-1f11-4272-b541-58e413cc3360', 'volume_size': 1} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1120227839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b6b8d5-1f11-4272-b541-58e413cc3360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5109ee3d654958a8b033d0cb25097c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:51:16Z,use_quota=True,user_id='7a65c72f7e1044738d9b6d0c70c38d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(002f150a-7204-476d-afcb-4d8885ee88ad),volume_type_id=002f150a-7204-476d-afcb-4d8885ee88ad)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Creating volume 83b6b8d5-1f11-4272-b541-58e413cc3360 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:51:17 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83b6b8d5-1f11-4272-b541-58e413cc3360 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:17 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=82, name=volume-83b6b8d5-1f11-4272-b541-58e413cc3360, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:51:17 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Volume volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 (15f4c4f6-532a-438a-b9c8-71a30750e5d5): created successfully Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fd8cbb-98cf-4d84-b98a-40e6a0e0d8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Flow 'volume_create_manager' (faa66c51-075a-42b8-b8a2-f3414f888bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:51:17 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-acafdab0-3d41-49e4-a4c9-97ba4277694e tempest-VolumesDeleteCascade-2049669152 None] Created volume successfully. Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83b6b8d5-1f11-4272-b541-58e413cc3360 1073741824" returned: 0 in 0.566s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83b6b8d5-1f11-4272-b541-58e413cc3360 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83b6b8d5-1f11-4272-b541-58e413cc3360" returned: 0 in 0.131s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] <== create_volume: return (751ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:51:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aedf37d-300e-4743-b389-7dc051c55e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b6b8d5-1f11-4272-b541-58e413cc3360', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbaecd9-ebc3-42c8-bcad-6f4543dffc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:18 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Volume volume-83b6b8d5-1f11-4272-b541-58e413cc3360 (83b6b8d5-1f11-4272-b541-58e413cc3360): created successfully Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbaecd9-ebc3-42c8-bcad-6f4543dffc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Flow 'volume_create_manager' (0b214fb5-4fee-4588-ae44-d209e19b46ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:51:18 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-442f9925-75eb-4922-8382-8f4ac0ee2a44 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Created volume successfully. Sep 10 17:51:18 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Creating offline snapshot ac1ad597-9124-4db7-8e32-8d4d8a737b3b of volume 15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f1c894-d89b-423a-b177-8b993c7ab1b6]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5" returned: 0 in 0.741s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:19 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=83, name=volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:51:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b 1G" returned: 0 in 0.383s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img rebase -u -b volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:19 devstack quobyte-client[82625]: System call of process 95836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img rebase -u -b volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b" returned: 0 in 0.306s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:51:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b" returned: 0 in 0.400s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:51:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b" returned: 0 in 0.284s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.info" returned: 0 in 0.312s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.info" returned: 0 in 0.234s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.920s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Acquiring lock "cinder-83b6b8d5-1f11-4272-b541-58e413cc3360-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.533s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:22 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:51:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f7d35104-85b4-4506-9be6-d11d017284b8 tempest-VolumesDeleteCascade-2049669152 None] Create snapshot completed successfully Sep 10 17:51:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "cinder-83b6b8d5-1f11-4272-b541-58e413cc3360-delete_volume" acquired by "delete_volume" :: waited 0.227s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9d6e385d-695e-4c92-a2c6-53320b91f8a0 tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Retype volume completed successfully. Sep 10 17:51:22 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Acquiring lock "cinder-quobyte-83b6b8d5-1f11-4272-b541-58e413cc3360" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "cinder-quobyte-83b6b8d5-1f11-4272-b541-58e413cc3360" acquired by "delete_volume" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:22 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d86b5d-b4ce-4281-9684-9fcc8b265363]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83b6b8d5-1f11-4272-b541-58e413cc3360 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83b6b8d5-1f11-4272-b541-58e413cc3360" returned: 0 in 0.586s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83b6b8d5-1f11-4272-b541-58e413cc3360 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83b6b8d5-1f11-4272-b541-58e413cc3360" returned: 0 in 0.174s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "cinder-quobyte-83b6b8d5-1f11-4272-b541-58e413cc3360" released by "delete_volume" :: held 1.072s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:24 devstack cinder-volume[82609]: WARNING cinder.quota [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:51:24 devstack cinder-volume[82609]: WARNING cinder.quota [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Created reservations ['8fa2f96a-6d4b-40e6-a675-c32537ccc106', 'f1b7d76b-9b14-4390-b7da-b2c0e4000f12', '28138bf2-4090-4c4d-a2d2-c2399013c224', '72a82666-c687-4a55-900a-463eb6bbcc6e'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:51:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Flow 'volume_create_manager' (546fc22d-4b85-4c40-a816-5180bb446bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde31988-d53f-4144-9ec3-9b7cd46401c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde31988-d53f-4144-9ec3-9b7cd46401c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-886214740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f11921-ddfa-4054-a59b-1363572b6408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9467d045bc4215b7658d686d6de49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac1ad597-9124-4db7-8e32-8d4d8a737b3b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:51:24Z,use_quota=True,user_id='9414f8f27ce549f9badf6a09fdc2457b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a630391-6181-417f-9f87-e7d642f987e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a630391-6181-417f-9f87-e7d642f987e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1efff5-bcb4-47ca-8474-e883d240db06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1efff5-bcb4-47ca-8474-e883d240db06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8f11921-ddfa-4054-a59b-1363572b6408', 'volume_name': 'volume-b8f11921-ddfa-4054-a59b-1363572b6408', 'volume_size': 1, 'snapshot_id': 'ac1ad597-9124-4db7-8e32-8d4d8a737b3b'}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439f57fa-1908-49a2-8293-c241219df461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439f57fa-1908-49a2-8293-c241219df461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28573781-6e1b-4680-a711-4f3dfedf90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:25 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Volume b8f11921-ddfa-4054-a59b-1363572b6408: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8f11921-ddfa-4054-a59b-1363572b6408', 'volume_size': 1, 'snapshot_id': 'ac1ad597-9124-4db7-8e32-8d4d8a737b3b'} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-ac1ad597-9124-4db7-8e32-8d4d8a737b3b-b8f11921-ddfa-4054-a59b-1363572b6408" by "_create_volume_from_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.849s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-ac1ad597-9124-4db7-8e32-8d4d8a737b3b-b8f11921-ddfa-4054-a59b-1363572b6408" acquired by "_create_volume_from_snapshot" :: waited 0.114s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Creating volume b8f11921-ddfa-4054-a59b-1363572b6408 from snapshot ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-b8f11921-ddfa-4054-a59b-1363572b6408" by "_copy_volume_from_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:25 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Deleted volume successfully. Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-b8f11921-ddfa-4054-a59b-1363572b6408" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] snapshot: ac1ad597-9124-4db7-8e32-8d4d8a737b3b, volume: b8f11921-ddfa-4054-a59b-1363572b6408, {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2c865d17-179c-4497-b532-81df7d3dbdcb tempest-VolumeRetypeWithoutMigrationTest-507901184 None] Lock "cinder-83b6b8d5-1f11-4272-b541-58e413cc3360-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f068b-a16d-468d-b90e-7deba2465321]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:26 devstack quobyte-client[82625]: System call of process 95859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b" returned: 0 in 0.641s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Creating direct copy from snapshot {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6457a2-ecba-491c-aceb-99ed70601f73]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5" returned: 0 in 0.486s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG cinder.utils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408 not found in is_blk_device check {{(pid=82609) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 17:51:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:27 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=85, name=volume-b8f11921-ddfa-4054-a59b-1363572b6408, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:51:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:51:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.149s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.671s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:51:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408" returned: 0 in 7.094s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:33 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa808e0-4477-4dc1-9684-31f35074ec4a]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:34 devstack quobyte-client[82625]: System call of process 95877 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5" returned: 0 in 0.614s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:34 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:51:34 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Converted 1024.00 MB image at 144.13 MB/s Sep 10 17:51:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:51:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408" returned: 0 in 0.134s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-b8f11921-ddfa-4054-a59b-1363572b6408" released by "_copy_volume_from_snapshot" :: held 9.423s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-ac1ad597-9124-4db7-8e32-8d4d8a737b3b-b8f11921-ddfa-4054-a59b-1363572b6408" released by "_create_volume_from_snapshot" :: held 9.503s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.633s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.760s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d53cfd-3230-495c-8baa-87a050688bc2]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=54,cinder:UPDATE=52,cinder:DELETE=5,cinder:INSERT=21 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28573781-6e1b-4680-a711-4f3dfedf90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f11921-ddfa-4054-a59b-1363572b6408', 'volume_size': 1, 'snapshot_id': 'ac1ad597-9124-4db7-8e32-8d4d8a737b3b'}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ee6724-7811-4357-bd16-f13b8f59d860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:51:35 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Volume volume-b8f11921-ddfa-4054-a59b-1363572b6408 (b8f11921-ddfa-4054-a59b-1363572b6408): created successfully Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ee6724-7811-4357-bd16-f13b8f59d860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Flow 'volume_create_manager' (546fc22d-4b85-4c40-a816-5180bb446bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:51:35 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-43f64a10-fb66-414e-9319-6175ead72d58 tempest-VolumesDeleteCascade-2049669152 None] Created volume successfully. Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 0 in 0.590s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 1 in 0.489s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:51:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.256s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-15f4c4f6-532a-438a-b9c8-71a30750e5d5-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-15f4c4f6-532a-438a-b9c8-71a30750e5d5-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31023408-d69a-4f3c-a99a-c8d4bfb31f55', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:51:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Performing cascade delete. {{(pid=82609) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 17:51:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-ac1ad597-9124-4db7-8e32-8d4d8a737b3b-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-ac1ad597-9124-4db7-8e32-8d4d8a737b3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:37 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-15f4c4f6-532a-438a-b9c8-71a30750e5d5" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-15f4c4f6-532a-438a-b9c8-71a30750e5d5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-ac1ad597-9124-4db7-8e32-8d4d8a737b3b" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-ac1ad597-9124-4db7-8e32-8d4d8a737b3b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Deleting offline snapshot ac1ad597-9124-4db7-8e32-8d4d8a737b3b of volume 15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] snapshot_file for this snap is: volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[e192fbd4-31fe-4dc3-bcfc-992aca683aed]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:37 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-70c0bc44-10da-4ad8-a96c-a5fdcfee0e93 req-fdadc3d3-03c9-4b05-929c-0cac0075ef9d tempest-TestShelveInstance-798093805 None] attachment_update completed successfully. Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b" returned: 0 in 0.659s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e785382-cc27-45f7-be4b-14779680add3]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:38 devstack quobyte-client[82625]: System call of process 95889 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5" returned: 0 in 0.498s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b" returned: 0 in 0.264s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5.ac1ad597-9124-4db7-8e32-8d4d8a737b3b" returned: 0 in 0.158s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-ac1ad597-9124-4db7-8e32-8d4d8a737b3b" released by "_delete_snapshot" :: held 2.021s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-15f4c4f6-532a-438a-b9c8-71a30750e5d5" released by "delete_snapshot" :: held 2.077s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=64,cinder:UPDATE=67,cinder:DELETE=6,cinder:INSERT=12 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Created reservations ['2a49d783-4194-4351-8e5c-e107ebbd3c32', '2cb8a6a6-814d-46bd-882e-5c3f6f315643', 'ba30bd4e-79d3-4d0e-9048-25d94b12d292', '209ec680-edb5-4e1b-ad20-2534bf3ee1e4'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:51:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Delete snapshot completed successfully. Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-ac1ad597-9124-4db7-8e32-8d4d8a737b3b-delete_snapshot" released by "delete_snapshot" :: held 2.630s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Snapshots deleted, issuing volume delete {{(pid=82609) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-15f4c4f6-532a-438a-b9c8-71a30750e5d5" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-15f4c4f6-532a-438a-b9c8-71a30750e5d5" acquired by "delete_volume" :: waited 0.032s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[30428185-9c8b-407b-8eb1-b63f5235647d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5" returned: 0 in 0.602s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-15f4c4f6-532a-438a-b9c8-71a30750e5d5" returned: 0 in 0.199s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-15f4c4f6-532a-438a-b9c8-71a30750e5d5" released by "delete_volume" :: held 1.143s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Created reservations ['1c0016d7-a0f4-4ee3-9634-b3ba36ffebd8', '9a009d31-8dbf-406f-81af-8806d9ed193e', '07aee49a-5d8e-4086-8203-bd5d60734a62', '582acb42-147a-4e79-976d-9b1e676ed219'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.153s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:51:41 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Deleted volume successfully. Sep 10 17:51:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d7a9f388-00ef-41b1-8d1b-1d6dcd7c7bc4 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-15f4c4f6-532a-438a-b9c8-71a30750e5d5-delete_volume" released by "delete_volume" :: held 5.107s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-b8f11921-ddfa-4054-a59b-1363572b6408-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-b8f11921-ddfa-4054-a59b-1363572b6408-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:43 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:51:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "cinder-quobyte-b8f11921-ddfa-4054-a59b-1363572b6408" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:51:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-b8f11921-ddfa-4054-a59b-1363572b6408" acquired by "delete_volume" :: waited 0.025s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:51:43 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6edb89-f8af-409b-b776-ea0a6ceb58d1]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:51:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:43 devstack quobyte-client[82625]: System call of process 96002 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:51:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408" returned: 0 in 0.757s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b8f11921-ddfa-4054-a59b-1363572b6408" returned: 0 in 0.207s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-quobyte-b8f11921-ddfa-4054-a59b-1363572b6408" released by "delete_volume" :: held 1.253s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:44 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Created reservations ['917e7cb0-36c3-4c23-8362-df8191f4710a', '2568113b-4db7-4d8f-865d-57c00551478e', '5fffb3d6-80e1-4d86-b234-fe041475fb6d', '7b73c99c-4c84-40cd-84b1-97b8dc8c0999'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.153s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:51:45 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Deleted volume successfully. Sep 10 17:51:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8bb7d585-6cd7-41e5-a491-4732b5dc9570 tempest-VolumesDeleteCascade-2049669152 None] Lock "cinder-b8f11921-ddfa-4054-a59b-1363572b6408-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:51:55 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:INSERT=5,cinder:UPDATE=23,cinder:SELECT=10,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:51:55 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:DELETE=2,cinder:UPDATE=21,cinder:SELECT=21,cinder:INSERT=7 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:52:14 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Flow 'volume_create_manager' (f567329c-a5c5-4414-a133-df4962e6990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b80de78-6ada-4d72-9d75-c50d79619208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b80de78-6ada-4d72-9d75-c50d79619208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1281552543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46118ff0-2d8b-4017-b363-d3d485352df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088ab464545142118ded4c62b3fc3870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:14Z,use_quota=True,user_id='afda057a895c4f3a8af67e852ea890fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1566b78b-01ed-4cbe-bae9-ae2750e03def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1566b78b-01ed-4cbe-bae9-ae2750e03def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0257c2d-00dc-4526-82b1-476cf50fe7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0257c2d-00dc-4526-82b1-476cf50fe7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46118ff0-2d8b-4017-b363-d3d485352df8', 'volume_name': 'volume-46118ff0-2d8b-4017-b363-d3d485352df8', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d74163-1ad6-48a4-83e0-2704dd8ee6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d74163-1ad6-48a4-83e0-2704dd8ee6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66793a49-d4e0-4b7f-89c3-bf718093ad3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:52:14 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Volume 46118ff0-2d8b-4017-b363-d3d485352df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46118ff0-2d8b-4017-b363-d3d485352df8', 'volume_size': 1} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1281552543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46118ff0-2d8b-4017-b363-d3d485352df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088ab464545142118ded4c62b3fc3870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:14Z,use_quota=True,user_id='afda057a895c4f3a8af67e852ea890fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Creating volume 46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:52:14 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:52:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:52:14 devstack quobyte-client[82625]: System call of process 96437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:52:14 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=86, name=volume-46118ff0-2d8b-4017-b363-d3d485352df8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 1073741824" returned: 0 in 0.729s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 0.179s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] <== create_volume: return (1014ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66793a49-d4e0-4b7f-89c3-bf718093ad3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46118ff0-2d8b-4017-b363-d3d485352df8', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a11013-d658-4b92-a7b2-01c72cb9b9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:52:15 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Volume volume-46118ff0-2d8b-4017-b363-d3d485352df8 (46118ff0-2d8b-4017-b363-d3d485352df8): created successfully Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a11013-d658-4b92-a7b2-01c72cb9b9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:52:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Flow 'volume_create_manager' (f567329c-a5c5-4414-a133-df4962e6990e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:52:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d15f71c8-5d9c-4ba8-9230-f6812fa4211f tempest-VolumesActionsTest-1819670117 None] Created volume successfully. Sep 10 17:52:25 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:52:25 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:52:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:52:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:52:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:52:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:52:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:52:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:52:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:52:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.517s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:52:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:52:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0f8951ba-f60d-448e-aa8a-fd8e547c924f tempest-VolumesActionsTest-1819670117 None] Acquiring lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8" by "attach_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:52:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0f8951ba-f60d-448e-aa8a-fd8e547c924f tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8" acquired by "attach_volume" :: waited 0.057s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:52:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0f8951ba-f60d-448e-aa8a-fd8e547c924f tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:52:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0f8951ba-f60d-448e-aa8a-fd8e547c924f tempest-VolumesActionsTest-1819670117 None] Attaching volume 46118ff0-2d8b-4017-b363-d3d485352df8 to instance e196582f-7846-4ea0-8196-5e3872bbbc98 at mountpoint /dev/vdb on host None. Sep 10 17:52:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0f8951ba-f60d-448e-aa8a-fd8e547c924f tempest-VolumesActionsTest-1819670117 None] Attach volume completed successfully. Sep 10 17:52:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0f8951ba-f60d-448e-aa8a-fd8e547c924f tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8" released by "attach_volume" :: held 0.751s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:52:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5bf96060-72c5-4bcb-a476-5f84cabd37ef tempest-VolumesActionsTest-1819670117 None] Acquiring lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-detach_volume" by "detach_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:52:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5bf96060-72c5-4bcb-a476-5f84cabd37ef tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:52:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5bf96060-72c5-4bcb-a476-5f84cabd37ef tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:52:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5bf96060-72c5-4bcb-a476-5f84cabd37ef tempest-VolumesActionsTest-1819670117 None] Detaching volume 46118ff0-2d8b-4017-b363-d3d485352df8 from instance e196582f-7846-4ea0-8196-5e3872bbbc98. Sep 10 17:52:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5bf96060-72c5-4bcb-a476-5f84cabd37ef tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:52:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5bf96060-72c5-4bcb-a476-5f84cabd37ef tempest-VolumesActionsTest-1819670117 None] Detach volume completed successfully. Sep 10 17:52:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5bf96060-72c5-4bcb-a476-5f84cabd37ef tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:06 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:INSERT=2,cinder:SELECT=3,cinder:UPDATE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:53:06 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:53:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (cc10ce72-0395-4243-81b4-330909c8547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3635bc3a-db37-4a90-adbc-b97b550f4ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3635bc3a-db37-4a90-adbc-b97b550f4ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1039837021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b29124-a6d4-4251-861f-ae33c69ea93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:15Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b1eb0c-d62d-4321-96aa-0954f19f7252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b1eb0c-d62d-4321-96aa-0954f19f7252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7b07c2-c806-4a5e-bbc8-c53ae87b128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7b07c2-c806-4a5e-bbc8-c53ae87b128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b29124-a6d4-4251-861f-ae33c69ea93c', 'volume_name': 'volume-77b29124-a6d4-4251-861f-ae33c69ea93c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901d31c1-42c0-499a-b791-eef774da9533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901d31c1-42c0-499a-b791-eef774da9533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2879b9-b50c-4443-a1c3-93626a9e3d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:15 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Volume 77b29124-a6d4-4251-861f-ae33c69ea93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b29124-a6d4-4251-861f-ae33c69ea93c', 'volume_size': 1} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1039837021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b29124-a6d4-4251-861f-ae33c69ea93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:15Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Creating volume 77b29124-a6d4-4251-861f-ae33c69ea93c {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:53:15 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:53:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77b29124-a6d4-4251-861f-ae33c69ea93c 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:16 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=87, name=volume-77b29124-a6d4-4251-861f-ae33c69ea93c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:53:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77b29124-a6d4-4251-861f-ae33c69ea93c 1073741824" returned: 0 in 1.053s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77b29124-a6d4-4251-861f-ae33c69ea93c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77b29124-a6d4-4251-861f-ae33c69ea93c" returned: 0 in 0.175s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] <== create_volume: return (1411ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:53:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2879b9-b50c-4443-a1c3-93626a9e3d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b29124-a6d4-4251-861f-ae33c69ea93c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978f99ad-cd78-44d2-9625-f6b1be723efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:17 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Volume volume-77b29124-a6d4-4251-861f-ae33c69ea93c (77b29124-a6d4-4251-861f-ae33c69ea93c): created successfully Sep 10 17:53:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978f99ad-cd78-44d2-9625-f6b1be723efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (cc10ce72-0395-4243-81b4-330909c8547b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:53:17 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-db1ef6c2-4cc3-4c05-882a-848a130b0c1a tempest-VolumesActionsTest-1457639220 None] Created volume successfully. Sep 10 17:53:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-16116623-82c6-434e-8b39-6008c41d2c2e tempest-VolumesActionsTest-1457639220 None] Acquiring lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c" by "attach_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-16116623-82c6-434e-8b39-6008c41d2c2e tempest-VolumesActionsTest-1457639220 None] Lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c" acquired by "attach_volume" :: waited 0.216s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-16116623-82c6-434e-8b39-6008c41d2c2e tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-16116623-82c6-434e-8b39-6008c41d2c2e tempest-VolumesActionsTest-1457639220 None] Attaching volume 77b29124-a6d4-4251-861f-ae33c69ea93c to instance b14ccaac-044e-4c7c-8013-73b439b02b16 at mountpoint /dev/vdb on host None. Sep 10 17:53:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-16116623-82c6-434e-8b39-6008c41d2c2e tempest-VolumesActionsTest-1457639220 None] Attach volume completed successfully. Sep 10 17:53:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-16116623-82c6-434e-8b39-6008c41d2c2e tempest-VolumesActionsTest-1457639220 None] Lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c" released by "attach_volume" :: held 0.615s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-2e0db0a9-d872-4b2a-8aed-070e4c06d78b req-03cdb89c-96db-484e-b350-45e289cd7926 tempest-TestShelveInstance-798093805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:20 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-2e0db0a9-d872-4b2a-8aed-070e4c06d78b req-03cdb89c-96db-484e-b350-45e289cd7926 tempest-TestShelveInstance-798093805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:20 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-2e0db0a9-d872-4b2a-8aed-070e4c06d78b req-03cdb89c-96db-484e-b350-45e289cd7926 tempest-TestShelveInstance-798093805 None] Terminate volume connection completed successfully. Sep 10 17:53:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-2e0db0a9-d872-4b2a-8aed-070e4c06d78b req-03cdb89c-96db-484e-b350-45e289cd7926 tempest-TestShelveInstance-798093805 None] Deleting attachment 31023408-d69a-4f3c-a99a-c8d4bfb31f55. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:53:20 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Terminate volume connection completed successfully. Sep 10 17:53:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-detach_volume" by "detach_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Detaching volume 77b29124-a6d4-4251-861f-ae33c69ea93c from instance b14ccaac-044e-4c7c-8013-73b439b02b16. Sep 10 17:53:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Detach volume completed successfully. Sep 10 17:53:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0e0c88e3-90b4-48f2-a167-e78c104250f0 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-detach_volume" released by "detach_volume" :: held 0.160s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d22410c-b459-4086-81d9-21a6035e3249 tempest-VolumesActionsTest-1457639220 None] Acquiring lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-detach_volume" by "detach_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d22410c-b459-4086-81d9-21a6035e3249 tempest-VolumesActionsTest-1457639220 None] Lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9d22410c-b459-4086-81d9-21a6035e3249 tempest-VolumesActionsTest-1457639220 None] Volume detach called, but volume not attached. Sep 10 17:53:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9d22410c-b459-4086-81d9-21a6035e3249 tempest-VolumesActionsTest-1457639220 None] Lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Acquiring lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:23 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Acquiring lock "cinder-quobyte-77b29124-a6d4-4251-861f-ae33c69ea93c" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Lock "cinder-quobyte-77b29124-a6d4-4251-861f-ae33c69ea93c" acquired by "delete_volume" :: waited 0.032s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d64986f-a4cc-44a7-91e5-2bce74f9df83]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:53:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77b29124-a6d4-4251-861f-ae33c69ea93c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:24 devstack quobyte-client[82625]: System call of process 96852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:53:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77b29124-a6d4-4251-861f-ae33c69ea93c" returned: 0 in 1.025s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77b29124-a6d4-4251-861f-ae33c69ea93c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77b29124-a6d4-4251-861f-ae33c69ea93c" returned: 0 in 0.184s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Lock "cinder-quobyte-77b29124-a6d4-4251-861f-ae33c69ea93c" released by "delete_volume" :: held 1.496s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:25 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Created reservations ['c0cb83d6-f780-4a72-b68e-67cacffcc384', 'ab5800a2-99d0-4dbe-b836-698b3751637a', 'e0432f5f-2b92-4735-9020-957289b7aff3', 'f19ea9ff-0f70-4419-8840-41dc9dccbdd1'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:53:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:53:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:53:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.441s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:53:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Deleted volume successfully. Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1948f3ef-ee9c-4b30-beda-273739cd8b07 tempest-VolumesActionsTest-1457639220 None] Lock "cinder-77b29124-a6d4-4251-861f-ae33c69ea93c-delete_volume" released by "delete_volume" :: held 3.675s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.433s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:53:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:31 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d77c297-4ede-4b08-8218-4db99084f071]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:53:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 0 in 0.845s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 1 in 0.747s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:53:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.958s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a659195-a7ff-4ecc-9916-a94e7ef1c040', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:53:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-6adc2e29-5e78-489b-81eb-69e6d436c67c req-87ec047f-fd11-4c43-b997-4b69693fcd3d tempest-TestShelveInstance-798093805 None] attachment_update completed successfully. Sep 10 17:53:44 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=15,cinder:SELECT=21,cinder:INSERT=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:53:44 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=20,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:53:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (44375d49-be9e-494a-ab66-d5b5c225c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48b82a5-108f-4e1c-b877-9490569b30c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48b82a5-108f-4e1c-b877-9490569b30c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779590643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93451691-f209-4fea-90c0-3e1e07335e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:45Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14ecb79-ab04-44d0-8a4b-a3cb6e99b698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14ecb79-ab04-44d0-8a4b-a3cb6e99b698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f960b8-0c6a-4a55-acf1-019414ccc610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f960b8-0c6a-4a55-acf1-019414ccc610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93451691-f209-4fea-90c0-3e1e07335e74', 'volume_name': 'volume-93451691-f209-4fea-90c0-3e1e07335e74', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e9d1b6-bbac-47f3-9403-5df876e0ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e9d1b6-bbac-47f3-9403-5df876e0ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da943b88-b3a8-4999-893f-48c59e28596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:45 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Volume 93451691-f209-4fea-90c0-3e1e07335e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93451691-f209-4fea-90c0-3e1e07335e74', 'volume_size': 1} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779590643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93451691-f209-4fea-90c0-3e1e07335e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:45Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Creating volume 93451691-f209-4fea-90c0-3e1e07335e74 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:53:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:53:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:53:46 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:53:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-93451691-f209-4fea-90c0-3e1e07335e74 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:46 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=88, name=volume-93451691-f209-4fea-90c0-3e1e07335e74, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:53:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-93451691-f209-4fea-90c0-3e1e07335e74 1073741824" returned: 0 in 1.454s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-93451691-f209-4fea-90c0-3e1e07335e74 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-93451691-f209-4fea-90c0-3e1e07335e74" returned: 0 in 0.571s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] <== create_volume: return (2215ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:53:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da943b88-b3a8-4999-893f-48c59e28596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93451691-f209-4fea-90c0-3e1e07335e74', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79925cd-6cf4-4a1f-a92d-4727c8d34dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Volume volume-93451691-f209-4fea-90c0-3e1e07335e74 (93451691-f209-4fea-90c0-3e1e07335e74): created successfully Sep 10 17:53:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79925cd-6cf4-4a1f-a92d-4727c8d34dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (44375d49-be9e-494a-ab66-d5b5c225c784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:53:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-92287868-0c2d-479e-8b58-b731c3645f41 tempest-VolumesActionsTest-1457639220 None] Created volume successfully. Sep 10 17:53:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-93451691-f209-4fea-90c0-3e1e07335e74-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-93451691-f209-4fea-90c0-3e1e07335e74-delete_volume" acquired by "delete_volume" :: waited 0.313s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:51 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-quobyte-93451691-f209-4fea-90c0-3e1e07335e74" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-quobyte-93451691-f209-4fea-90c0-3e1e07335e74" acquired by "delete_volume" :: waited 0.052s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:51 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfef66a5-5a54-4e5f-ac90-ce67c906bfba]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:53:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-93451691-f209-4fea-90c0-3e1e07335e74 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:52 devstack quobyte-client[82625]: System call of process 97444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:53:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-93451691-f209-4fea-90c0-3e1e07335e74" returned: 0 in 0.837s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-93451691-f209-4fea-90c0-3e1e07335e74 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-93451691-f209-4fea-90c0-3e1e07335e74" returned: 0 in 0.411s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-quobyte-93451691-f209-4fea-90c0-3e1e07335e74" released by "delete_volume" :: held 1.799s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dc579adf-7a65-4475-b227-c3f38e7a10dc tempest-VolumesActionsTest-1819670117 None] Acquiring lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8" by "attach_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dc579adf-7a65-4475-b227-c3f38e7a10dc tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8" acquired by "attach_volume" :: waited 0.071s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:55 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Created reservations ['6d42eb04-b709-4dd1-afee-2b4844b5cea2', '39ba9e7e-c36e-4a1f-a69c-111a90c0f8f5', 'aa16f6d3-4f22-4ccb-9102-0eb7bf430237', 'cd7a1848-a09e-4b65-a83d-4e7d88108321'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:53:55 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-dc579adf-7a65-4475-b227-c3f38e7a10dc tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:55 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-dc579adf-7a65-4475-b227-c3f38e7a10dc tempest-VolumesActionsTest-1819670117 None] Attaching volume 46118ff0-2d8b-4017-b363-d3d485352df8 to instance 5c7563ee-e82b-4e1f-b576-e96a97785aa9 at mountpoint /dev/vdb on host None. Sep 10 17:53:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-dc579adf-7a65-4475-b227-c3f38e7a10dc tempest-VolumesActionsTest-1819670117 None] Attach volume completed successfully. Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-dc579adf-7a65-4475-b227-c3f38e7a10dc tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8" released by "attach_volume" :: held 1.889s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.584s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:53:56 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:53:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Deleted volume successfully. Sep 10 17:53:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-abd1beaa-cd65-4b53-9a18-c24f20d60181 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-93451691-f209-4fea-90c0-3e1e07335e74-delete_volume" released by "delete_volume" :: held 6.662s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d65ff6a1-9e2b-4af8-ac25-5f409e920211 tempest-VolumesActionsTest-1819670117 None] Acquiring lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-detach_volume" by "detach_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:53:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d65ff6a1-9e2b-4af8-ac25-5f409e920211 tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-detach_volume" acquired by "detach_volume" :: waited 0.188s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:53:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d65ff6a1-9e2b-4af8-ac25-5f409e920211 tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d65ff6a1-9e2b-4af8-ac25-5f409e920211 tempest-VolumesActionsTest-1819670117 None] Detaching volume 46118ff0-2d8b-4017-b363-d3d485352df8 from instance 5c7563ee-e82b-4e1f-b576-e96a97785aa9. Sep 10 17:53:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d65ff6a1-9e2b-4af8-ac25-5f409e920211 tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d65ff6a1-9e2b-4af8-ac25-5f409e920211 tempest-VolumesActionsTest-1819670117 None] Detach volume completed successfully. Sep 10 17:53:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d65ff6a1-9e2b-4af8-ac25-5f409e920211 tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-detach_volume" released by "detach_volume" :: held 0.680s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:53:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:53:58 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:53:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (c92a650a-b9f1-4173-b352-6305846aaf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:53:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580fdf53-33f9-4589-a8a5-9d9b5727a80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580fdf53-33f9-4589-a8a5-9d9b5727a80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197259287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d478ccf5-2faa-4225-81f2-4f89dd2fcff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:58Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8912ef-b09b-4bd0-ac5f-003b628158af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8912ef-b09b-4bd0-ac5f-003b628158af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cff851-21e4-49c6-baa2-78b9ef1a8c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cff851-21e4-49c6-baa2-78b9ef1a8c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd478ccf5-2faa-4225-81f2-4f89dd2fcff6', 'volume_name': 'volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ec3df9-7947-4048-bf07-470895d14b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ec3df9-7947-4048-bf07-470895d14b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7603e7ab-f050-40b0-9235-c9f5658334fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:53:59 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Volume d478ccf5-2faa-4225-81f2-4f89dd2fcff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6', 'volume_size': 1} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197259287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d478ccf5-2faa-4225-81f2-4f89dd2fcff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:58Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Creating volume d478ccf5-2faa-4225-81f2-4f89dd2fcff6 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:53:59 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:53:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:53:59 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=89, name=volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:54:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6 1073741824" returned: 0 in 1.097s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6" returned: 0 in 0.293s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] <== create_volume: return (1751ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:54:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:54:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7603e7ab-f050-40b0-9235-c9f5658334fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a615ee55-b8db-4e8b-9361-7a7a4d4d2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:02 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Volume volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6 (d478ccf5-2faa-4225-81f2-4f89dd2fcff6): created successfully Sep 10 17:54:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a615ee55-b8db-4e8b-9361-7a7a4d4d2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (c92a650a-b9f1-4173-b352-6305846aaf7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:54:02 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7120a168-89fa-4a69-a1ac-f8d91a527fb6 tempest-VolumesActionsTest-1457639220 None] Created volume successfully. Sep 10 17:54:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-d478ccf5-2faa-4225-81f2-4f89dd2fcff6-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:54:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-d478ccf5-2faa-4225-81f2-4f89dd2fcff6-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:54:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:54:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-quobyte-d478ccf5-2faa-4225-81f2-4f89dd2fcff6" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:54:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-quobyte-d478ccf5-2faa-4225-81f2-4f89dd2fcff6" acquired by "delete_volume" :: waited 0.016s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:54:04 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d06b623-67b6-40fb-8017-bb5dc52d5b89]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:54:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6" returned: 0 in 0.712s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-d478ccf5-2faa-4225-81f2-4f89dd2fcff6" returned: 0 in 0.136s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-quobyte-d478ccf5-2faa-4225-81f2-4f89dd2fcff6" released by "delete_volume" :: held 1.059s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Created reservations ['daf441d4-81c9-46b9-b1a6-8be4486feb7f', '7ba5bc72-c127-48fa-b920-34df8b05925b', 'ecdd33e5-c897-49a8-b96d-64d3653a1c5b', 'd0ccb156-7717-41ae-9ab4-e94c98248c01'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.112s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:06 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:54:07 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Deleted volume successfully. Sep 10 17:54:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-62cdb21b-8f12-4040-85f2-a730b76afdd5 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-d478ccf5-2faa-4225-81f2-4f89dd2fcff6-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:54:08 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:54:08 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (da80a5dd-6b9a-48ab-9ac6-511e8befb388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6b10be-ea73-47cc-a044-b6b826ab5bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6b10be-ea73-47cc-a044-b6b826ab5bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-898170175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910f4905-c6df-4d72-b6ec-ba3198e0b68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:09Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32bc300-31a5-471e-a827-85613f5570f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32bc300-31a5-471e-a827-85613f5570f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1179f41d-ed5f-4135-8978-171f2f90d907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1179f41d-ed5f-4135-8978-171f2f90d907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910f4905-c6df-4d72-b6ec-ba3198e0b68b', 'volume_name': 'volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b59310-fb23-4c56-9e06-7a1aefe359ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b59310-fb23-4c56-9e06-7a1aefe359ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f36e0f3-d2f0-40fb-8f69-7659ae5d4d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:09 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Volume 910f4905-c6df-4d72-b6ec-ba3198e0b68b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b', 'volume_size': 1} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-898170175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910f4905-c6df-4d72-b6ec-ba3198e0b68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:09Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Creating volume 910f4905-c6df-4d72-b6ec-ba3198e0b68b {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:54:09 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:54:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:09 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=90, name=volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:54:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b 1073741824" returned: 0 in 1.138s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b" returned: 0 in 0.213s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] <== create_volume: return (1425ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:54:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:54:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f36e0f3-d2f0-40fb-8f69-7659ae5d4d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd9179d-6e7e-4132-a777-a44707d86d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:11 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Volume volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b (910f4905-c6df-4d72-b6ec-ba3198e0b68b): created successfully Sep 10 17:54:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd9179d-6e7e-4132-a777-a44707d86d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:11 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (da80a5dd-6b9a-48ab-9ac6-511e8befb388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:54:11 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-248461bc-3207-4c8c-9711-32450876f95a tempest-VolumesActionsTest-1457639220 None] Created volume successfully. Sep 10 17:54:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-910f4905-c6df-4d72-b6ec-ba3198e0b68b-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:54:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-910f4905-c6df-4d72-b6ec-ba3198e0b68b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:54:13 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:54:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-quobyte-910f4905-c6df-4d72-b6ec-ba3198e0b68b" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:54:13 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-quobyte-910f4905-c6df-4d72-b6ec-ba3198e0b68b" acquired by "delete_volume" :: waited 0.057s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:54:13 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[643c3e69-132c-44b4-901f-625d406f78de]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:54:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b" returned: 0 in 1.073s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:54:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:54:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:54:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-910f4905-c6df-4d72-b6ec-ba3198e0b68b" returned: 0 in 0.829s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:15 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf07c81c-c5ee-4f9a-a52d-d9fc04cfe08f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:54:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:16 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-quobyte-910f4905-c6df-4d72-b6ec-ba3198e0b68b" released by "delete_volume" :: held 2.619s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:54:17 devstack quobyte-client[82625]: System call of process 97611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:54:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 1.809s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:17 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Created reservations ['e23e7930-e4ca-4834-8107-d0805260d32e', '965f49ac-243a-45ee-9e06-144d4c6de154', '0b17515a-af4d-424a-b2e4-0752cdcd19ca', '3c4e717c-f4e0-4708-bb11-161e3092f710'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:54:17 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f7456-8164-4d6e-aa39-318aa650a6c2]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:54:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 0.891s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.ff28b874-03c5-490e-84a2-f712cb6a43a9ivvzm4uf.img {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:54:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.110s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:54:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:54:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:54:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.287s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:54:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 1.129s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:22 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:54:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Deleted volume successfully. Sep 10 17:54:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f4100106-70bc-4e32-9ea1-a0eb05459950 tempest-VolumesActionsTest-1232763844 None] Lock "cinder-910f4905-c6df-4d72-b6ec-ba3198e0b68b-delete_volume" released by "delete_volume" :: held 12.161s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:54:25 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:54:25 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:54:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (69b04109-f046-42bc-9bcc-ba92c02b3dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:54:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd41e8f-feb6-47d6-b7bc-bcbc574e8f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd41e8f-feb6-47d6-b7bc-bcbc574e8f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-694656916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf9b6e6-f874-4968-9e8a-b5828c90188d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:24Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb06edc-cf2f-40ba-9b81-7f5457d70436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb06edc-cf2f-40ba-9b81-7f5457d70436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45600aa2-ac04-4f0e-aa13-aa6206074803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45600aa2-ac04-4f0e-aa13-aa6206074803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf9b6e6-f874-4968-9e8a-b5828c90188d', 'volume_name': 'volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e5cb92-7a1d-471c-b600-80315ee2fcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e5cb92-7a1d-471c-b600-80315ee2fcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a4d094-636b-445c-b0bd-74f7080ce554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:54:27 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Volume 3bf9b6e6-f874-4968-9e8a-b5828c90188d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d', 'volume_size': 1} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.151s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:54:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 1.659s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:29 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:54:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.ff28b874-03c5-490e-84a2-f712cb6a43a9ivvzm4uf.img" returned: 0 in 13.799s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:32 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[700694ba-097d-49f4-a853-dbb3f8db9974]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:54:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:54:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 0.728s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:54:32 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8, size 1024.00 MB, duration 13.81 sec, destination /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.ff28b874-03c5-490e-84a2-f712cb6a43a9ivvzm4uf.img {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:54:32 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Converted 1024.00 MB image at 74.13 MB/s Sep 10 17:54:33 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] ff28b874-03c5-490e-84a2-f712cb6a43a9 was raw, no need to convert to raw {{(pid=82609) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 10 17:54:36 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=27,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=9 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:54:43 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=35,cinder:SELECT=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:55:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-116330ce-4225-45a4-b365-f7bb4b20705b tempest-TestShelveInstance-798093805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-116330ce-4225-45a4-b365-f7bb4b20705b tempest-TestShelveInstance-798093805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-116330ce-4225-45a4-b365-f7bb4b20705b tempest-TestShelveInstance-798093805 None] Terminate volume connection completed successfully. Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-116330ce-4225-45a4-b365-f7bb4b20705b tempest-TestShelveInstance-798093805 None] Deleting attachment 1a659195-a7ff-4ecc-9916-a94e7ef1c040. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 64.305s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Uploaded volume to glance image-id: ff28b874-03c5-490e-84a2-f712cb6a43a9. {{(pid=82609) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 52.275s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-694656916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf9b6e6-f874-4968-9e8a-b5828c90188d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:24Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Creating volume 3bf9b6e6-f874-4968-9e8a-b5828c90188d {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:55:19 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:55:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:19 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=91, name=volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:55:20 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2e861e57-b3aa-49db-b3b6-bb877355c569 tempest-VolumesActionsTest-1819670117 None] Copy volume to image completed successfully. Sep 10 17:55:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d 1073741824" returned: 0 in 0.626s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:20 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Acquiring lock "cinder-c3338acc-ee94-4c9b-9f41-deb3121f3c0b-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:55:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d" returned: 0 in 0.373s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] <== create_volume: return (1032ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:55:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:20 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Lock "cinder-c3338acc-ee94-4c9b-9f41-deb3121f3c0b-delete_volume" acquired by "delete_volume" :: waited 0.323s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a4d094-636b-445c-b0bd-74f7080ce554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4703483-b32a-4db5-a8a9-ae1b15c53700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:21 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Volume volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d (3bf9b6e6-f874-4968-9e8a-b5828c90188d): created successfully Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4703483-b32a-4db5-a8a9-ae1b15c53700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (69b04109-f046-42bc-9bcc-ba92c02b3dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:55:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Acquiring lock "cinder-quobyte-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Lock "cinder-quobyte-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" acquired by "delete_volume" :: waited 0.021s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:55:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3f62252d-b02c-4bf3-b77e-cb428798af8e tempest-VolumesActionsTest-1457639220 None] Created volume successfully. Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c78bac0-9f05-4fe0-9afb-6337746ac450]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:21 devstack quobyte-client[82625]: System call of process 97986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 0 in 0.549s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 1 in 0.754s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:55:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:23 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-3bf9b6e6-f874-4968-9e8a-b5828c90188d-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed549e-0126-43f5-a628-d82c6ffd09a2]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" returned: 0 in 0.568s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Lock "cinder-3bf9b6e6-f874-4968-9e8a-b5828c90188d-delete_volume" acquired by "delete_volume" :: waited 0.330s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Lock "cinder-quobyte-c3338acc-ee94-4c9b-9f41-deb3121f3c0b" released by "delete_volume" :: held 2.332s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:55:23 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Acquiring lock "cinder-quobyte-3bf9b6e6-f874-4968-9e8a-b5828c90188d" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 0.692s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Lock "cinder-quobyte-3bf9b6e6-f874-4968-9e8a-b5828c90188d" acquired by "delete_volume" :: waited 0.033s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b426c291-849b-455c-8eab-f5969e7bc446]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ec65bf-4afc-440a-b828-f6e53bdc2651]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:24 devstack cinder-volume[82609]: DEBUG cinder.quota [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Created reservations ['37457d5a-c45a-47a6-b83d-ffe4abb6c767', '7295779b-82f6-4631-9bca-b833b6bc9b8c', 'd4bb0ddc-a43f-448f-b026-61aa6fdc07db', '8989db48-aed1-4293-9cd5-735e7a9ac9fb'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:55:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 1.003s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:25 devstack quobyte-client[82625]: System call of process 98002 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.037s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d" returned: 0 in 1.466s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3bf9b6e6-f874-4968-9e8a-b5828c90188d" returned: 0 in 0.341s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.922s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:26 devstack cinder-volume[82609]: DEBUG cinder.manager [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:55:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Deleted volume successfully. Sep 10 17:55:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Lock "cinder-quobyte-3bf9b6e6-f874-4968-9e8a-b5828c90188d" released by "delete_volume" :: held 2.962s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:55:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [req-149c7443-37cc-4045-9cbc-989bb1162f49 req-4676f8b6-702c-471a-bfd3-88cd23f214c6 tempest-TestShelveInstance-798093805 None] Lock "cinder-c3338acc-ee94-4c9b-9f41-deb3121f3c0b-delete_volume" released by "delete_volume" :: held 6.346s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:55:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:55:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 1.318s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:55:29 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Created reservations ['6d0f28e7-651d-4e4c-98fd-727543539a62', 'fa6d077a-8465-4342-a830-8f45b32c8fa5', '68d63c86-b02d-4e4c-9036-d28b5268ff0d', '4ad4acb9-561b-4805-8cc8-b7ed9d665212'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:55:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.530s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:30 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:55:31 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Deleted volume successfully. Sep 10 17:55:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d745cae-5357-4245-b9e8-859969f0d52a tempest-VolumesActionsTest-1232763844 None] Lock "cinder-3bf9b6e6-f874-4968-9e8a-b5828c90188d-delete_volume" released by "delete_volume" :: held 8.968s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:55:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img" returned: 0 in 8.097s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:33 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[38024309-a7ac-4e1a-bc4f-17e63d42751c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:33 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:33 devstack quobyte-client[82625]: System call of process 98020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:55:33 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (5e9acb6c-e49c-4776-a6da-2da1acfb3242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09bab8c5-faf7-45e8-ba7d-c2393e936b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09bab8c5-faf7-45e8-ba7d-c2393e936b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1062129218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054e1ca1-844f-49f5-b54b-99b6bb44a6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:33Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7469ada-cadd-4a5a-a92c-b2e5aa069256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7469ada-cadd-4a5a-a92c-b2e5aa069256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e5b505-8a67-44d7-81b1-b1057037597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e5b505-8a67-44d7-81b1-b1057037597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054e1ca1-844f-49f5-b54b-99b6bb44a6ba', 'volume_name': 'volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d9da9-856d-48dc-a6a2-8f668a058488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d9da9-856d-48dc-a6a2-8f668a058488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1722829a-7507-4175-901d-d7ab0c28a135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:34 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Volume 054e1ca1-844f-49f5-b54b-99b6bb44a6ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba', 'volume_size': 1} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 1.115s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8, size 1024.00 MB, duration 8.10 sec, destination /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:55:34 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Converted 1024.00 MB image at 126.37 MB/s Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] c70762c9-f3bf-41b8-bc0f-a1425674f63b was raw, converting to qcow2 {{(pid=82609) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f1ccac-2c93-4c34-9ef0-0835a287b2f6]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img" returned: 0 in 0.472s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img" returned: 1 in 0.433s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:55:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img /opt/stack/data/cinder/conversion/vol_upload_uqrs9jf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img /opt/stack/data/cinder/conversion/vol_upload_uqrs9jf0" returned: 0 in 0.337s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:35 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Image conversion details: src /opt/stack/data/cinder/conversion/46118ff0-2d8b-4017-b363-d3d485352df8.temp_image.c70762c9-f3bf-41b8-bc0f-a1425674f63b45omglq1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_uqrs9jf0 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:55:35 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 10 17:55:35 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb25fe75-7308-404b-b0d0-8fde79dc0c6e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uqrs9jf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uqrs9jf0" returned: 0 in 0.406s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.249s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Uploaded volume to glance image-id: c70762c9-f3bf-41b8-bc0f-a1425674f63b. {{(pid=82609) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.132s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1062129218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054e1ca1-844f-49f5-b54b-99b6bb44a6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56593c89f254db6b17ba8575f5936dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:33Z,use_quota=True,user_id='4bd02b4a4879488b97f2f793526c47c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Creating volume 054e1ca1-844f-49f5-b54b-99b6bb44a6ba {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:55:38 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:38 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=92, name=volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:55:38 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-703d2158-35bc-467d-ad80-9d342c04ea27 tempest-VolumesActionsTest-1819670117 None] Copy volume to image completed successfully. Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba 1073741824" returned: 0 in 0.465s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba" returned: 0 in 0.110s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] <== create_volume: return (632ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:55:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1722829a-7507-4175-901d-d7ab0c28a135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889785da-6f7d-44fc-98b1-57564d2f5a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:39 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Volume volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba (054e1ca1-844f-49f5-b54b-99b6bb44a6ba): created successfully Sep 10 17:55:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889785da-6f7d-44fc-98b1-57564d2f5a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Flow 'volume_create_manager' (5e9acb6c-e49c-4776-a6da-2da1acfb3242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:55:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7f61ef07-3e54-41df-9b83-9b36bb96522a tempest-VolumesActionsTest-1457639220 None] Created volume successfully. Sep 10 17:55:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Acquiring lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:55:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:55:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Acquiring lock "cinder-quobyte-46118ff0-2d8b-4017-b363-d3d485352df8" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:55:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Lock "cinder-quobyte-46118ff0-2d8b-4017-b363-d3d485352df8" acquired by "delete_volume" :: waited 0.028s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:55:40 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b23bf2-7161-4a4b-b93b-22a6813a9f87]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:41 devstack quobyte-client[82625]: System call of process 98040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:55:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 0.737s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Acquiring lock "cinder-054e1ca1-844f-49f5-b54b-99b6bb44a6ba-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-46118ff0-2d8b-4017-b363-d3d485352df8" returned: 0 in 0.386s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Lock "cinder-054e1ca1-844f-49f5-b54b-99b6bb44a6ba-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Lock "cinder-quobyte-46118ff0-2d8b-4017-b363-d3d485352df8" released by "delete_volume" :: held 1.326s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Created reservations ['54dd7c24-5beb-4cca-9b0f-5e9cad1293b6', 'a63c819c-32d8-41d8-bea4-ca462b79b86d', '673626ea-a48e-46de-a4dc-ac0a51221f45', '90e17f36-ab08-4a22-8e65-36337bf13949'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:55:42 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Acquiring lock "cinder-quobyte-054e1ca1-844f-49f5-b54b-99b6bb44a6ba" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Lock "cinder-quobyte-054e1ca1-844f-49f5-b54b-99b6bb44a6ba" acquired by "delete_volume" :: waited 0.039s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[4012b0c8-6a87-4917-957c-6f66f2df9024]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.171s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:42 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:55:42 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Deleted volume successfully. Sep 10 17:55:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c9e27914-28e4-429c-ba1c-893dea8a3154 tempest-VolumesActionsTest-1819670117 None] Lock "cinder-46118ff0-2d8b-4017-b363-d3d485352df8-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:55:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba" returned: 0 in 0.936s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-054e1ca1-844f-49f5-b54b-99b6bb44a6ba" returned: 0 in 0.167s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Lock "cinder-quobyte-054e1ca1-844f-49f5-b54b-99b6bb44a6ba" released by "delete_volume" :: held 1.386s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Created reservations ['f8c7dc20-f592-4310-ab84-f4d3842ddfe0', '1273096f-0bb5-48a5-ad49-a897ce30b4d4', '96e0282c-20f9-4d21-8301-49bdd1daf0ce', 'a90bfc64-1394-4435-883e-082ad617d146'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.124s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:55:44 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Deleted volume successfully. Sep 10 17:55:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-2d9c7cb6-53ad-4e94-97e3-0bee480f233b tempest-VolumesActionsTest-1457639220 None] Lock "cinder-054e1ca1-844f-49f5-b54b-99b6bb44a6ba-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:55:54 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=25,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:55:54 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=25,cinder:UPDATE=33,cinder:DELETE=4,cinder:INSERT=7 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:55:55 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Flow 'volume_create_manager' (712e2cd7-033b-4810-a81e-3ebebf6b2e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ee67a4-9ce0-466d-85b0-fc7a0aa3d150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ee67a4-9ce0-466d-85b0-fc7a0aa3d150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1e3402-9961-45e2-be16-906d8cfb9d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de527d8ee23a445c972e7a76786f1d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:55Z,use_quota=True,user_id='1459a39547b748a4bbb838b65a54ee63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c30ca0d-0fa5-4241-a4be-f182ae222530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c30ca0d-0fa5-4241-a4be-f182ae222530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9c3773-a26f-4879-ba82-d2c9d3caf3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9c3773-a26f-4879-ba82-d2c9d3caf3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1e3402-9961-45e2-be16-906d8cfb9d32', 'volume_name': 'volume-3b1e3402-9961-45e2-be16-906d8cfb9d32', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cd3356-a948-4dd5-9e38-6397a2f7b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cd3356-a948-4dd5-9e38-6397a2f7b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf055a1-78d8-480d-bea9-bccc9ab4d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:55 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Volume 3b1e3402-9961-45e2-be16-906d8cfb9d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1e3402-9961-45e2-be16-906d8cfb9d32', 'volume_size': 1} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1e3402-9961-45e2-be16-906d8cfb9d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de527d8ee23a445c972e7a76786f1d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:55Z,use_quota=True,user_id='1459a39547b748a4bbb838b65a54ee63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Creating volume 3b1e3402-9961-45e2-be16-906d8cfb9d32 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:55:55 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:55:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3b1e3402-9961-45e2-be16-906d8cfb9d32 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:56 devstack quobyte-client[82625]: System call of process 98092 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:55:56 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=93, name=volume-3b1e3402-9961-45e2-be16-906d8cfb9d32, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:55:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Flow 'volume_create_manager' (02ec6453-728f-45da-8394-1ec09f0ffbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bb1f63-cda9-411d-8bdb-fd033ca00f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3b1e3402-9961-45e2-be16-906d8cfb9d32 1073741824" returned: 0 in 0.644s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3b1e3402-9961-45e2-be16-906d8cfb9d32 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bb1f63-cda9-411d-8bdb-fd033ca00f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-335249112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec93750-3351-4394-874d-d47db3f4fa70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32455874977f4c72ab81517bf28fdacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:56Z,use_quota=True,user_id='0fc19cca831d45b59afaa09a75797111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4a4702-2aef-4ea6-b177-7d9b58b48114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4a4702-2aef-4ea6-b177-7d9b58b48114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a59cd8-17d9-427e-b369-2a45f917bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3b1e3402-9961-45e2-be16-906d8cfb9d32" returned: 0 in 0.348s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] <== create_volume: return (1012ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:55:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf055a1-78d8-480d-bea9-bccc9ab4d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1e3402-9961-45e2-be16-906d8cfb9d32', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b735c758-13cb-4939-8245-fc3bec14dc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Volume volume-3b1e3402-9961-45e2-be16-906d8cfb9d32 (3b1e3402-9961-45e2-be16-906d8cfb9d32): created successfully Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b735c758-13cb-4939-8245-fc3bec14dc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Flow 'volume_create_manager' (712e2cd7-033b-4810-a81e-3ebebf6b2e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a59cd8-17d9-427e-b369-2a45f917bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dec93750-3351-4394-874d-d47db3f4fa70', 'volume_name': 'volume-dec93750-3351-4394-874d-d47db3f4fa70', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef1287e-0fe0-496d-91fc-169e237f808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef1287e-0fe0-496d-91fc-169e237f808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c088873-e98f-474c-97ff-924fd9092a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Volume dec93750-3351-4394-874d-d47db3f4fa70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dec93750-3351-4394-874d-d47db3f4fa70', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 17:55:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Cloning dec93750-3351-4394-874d-d47db3f4fa70 from image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 at location (None, None). {{(pid=82609) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 17:55:57 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ea92d66d-3513-42ed-a6ce-8a73143468a7 tempest-CinderUnicodeTest-153552093 None] Created volume successfully. Sep 10 17:55:58 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 17:55:58 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Image download 20.69 MB at 20.69 MB/s Sep 10 17:55:58 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cecfec-293d-499a-ba61-2a0361ddf1d6]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:55:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:58 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD Sep 10 17:55:58 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:55:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:55:58 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Flow 'volume_create_manager' (4a5a03b7-423c-4636-a3ce-17d46d40efbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083426d7-82da-4fe8-afda-31b595997eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083426d7-82da-4fe8-afda-31b595997eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:55:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1924042259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ce4e6d-bf42-4614-a068-2309f1d685c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de527d8ee23a445c972e7a76786f1d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:59Z,use_quota=True,user_id='1459a39547b748a4bbb838b65a54ee63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a99f8aa-2bce-453f-b989-13f2cd5db800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a99f8aa-2bce-453f-b989-13f2cd5db800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc28025d-5107-462c-81aa-ef4813089a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc28025d-5107-462c-81aa-ef4813089a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ce4e6d-bf42-4614-a068-2309f1d685c5', 'volume_name': 'volume-77ce4e6d-bf42-4614-a068-2309f1d685c5', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5effedb6-10b5-486c-acab-59ad04fe9de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5effedb6-10b5-486c-acab-59ad04fe9de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a24ed9-2306-4064-9b85-3747f88fe469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:55:59 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Volume 77ce4e6d-bf42-4614-a068-2309f1d685c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ce4e6d-bf42-4614-a068-2309f1d685c5', 'volume_size': 1} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:55:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1924042259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ce4e6d-bf42-4614-a068-2309f1d685c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de527d8ee23a445c972e7a76786f1d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:59Z,use_quota=True,user_id='1459a39547b748a4bbb838b65a54ee63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Creating volume 77ce4e6d-bf42-4614-a068-2309f1d685c5 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:55:59 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:55:59 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=94, name=volume-77ce4e6d-bf42-4614-a068-2309f1d685c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 1073741824" returned: 0 in 0.496s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:55:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5" returned: 0 in 0.387s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] <== create_volume: return (967ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:56:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a24ed9-2306-4064-9b85-3747f88fe469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ce4e6d-bf42-4614-a068-2309f1d685c5', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c23c2-6a23-4600-beb8-197574bf8f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:00 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Volume volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 (77ce4e6d-bf42-4614-a068-2309f1d685c5): created successfully Sep 10 17:56:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c23c2-6a23-4600-beb8-197574bf8f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Flow 'volume_create_manager' (4a5a03b7-423c-4636-a3ce-17d46d40efbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:00 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-18e8d4da-9e9d-425a-a1c1-89a9d6e15dce tempest-CinderUnicodeTest-153552093 None] Created volume successfully. Sep 10 17:56:01 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 10 17:56:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD" returned: 0 in 3.178s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:01 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Temporary image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 is fetched for user 0fc19cca831d45b59afaa09a75797111. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 17:56:01 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:01 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95748d7-8917-4829-9347-c1c81321dcac]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Creating offline snapshot 86112b24-0fce-47f7-853f-13d7e9da31b4 of volume 77ce4e6d-bf42-4614-a068-2309f1d685c5 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:56:02 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[46945be9-e6d1-4271-b2ed-dad558984656]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:02 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD Sep 10 17:56:02 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:56:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5" returned: 0 in 0.636s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:03 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=95, name=volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 1G" returned: 0 in 0.345s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): qemu-img rebase -u -b volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] CMD "qemu-img rebase -u -b volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4" returned: 0 in 0.217s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4" returned: 0 in 0.194s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4" returned: 0 in 0.119s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.info" returned: 0 in 0.212s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.info" returned: 0 in 0.124s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7bc6fab8-37d0-4e37-8ea6-223c9bfa7fb1 tempest-CinderUnicodeTest-153552093 None] Create snapshot completed successfully Sep 10 17:56:05 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD" returned: 0 in 3.329s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-335249112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec93750-3351-4394-874d-d47db3f4fa70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32455874977f4c72ab81517bf28fdacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:56Z,use_quota=True,user_id='0fc19cca831d45b59afaa09a75797111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Creating volume dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:56:05 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:05 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=97, name=volume-dec93750-3351-4394-874d-d47db3f4fa70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 1073741824" returned: 0 in 0.361s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 0 in 0.161s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] <== create_volume: return (626ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:56:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "cinder-86112b24-0fce-47f7-853f-13d7e9da31b4-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-86112b24-0fce-47f7-853f-13d7e9da31b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.105s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:06 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "cinder-quobyte-77ce4e6d-bf42-4614-a068-2309f1d685c5" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Attempting download of 36810fdd-7157-4a06-a4dd-33f26a5e8f64 ((None, None)) to volume dec93750-3351-4394-874d-d47db3f4fa70. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-quobyte-77ce4e6d-bf42-4614-a068-2309f1d685c5" acquired by "delete_snapshot" :: waited 0.053s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "cinder-quobyte-86112b24-0fce-47f7-853f-13d7e9da31b4" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-quobyte-86112b24-0fce-47f7-853f-13d7e9da31b4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Deleting offline snapshot 86112b24-0fce-47f7-853f-13d7e9da31b4 of volume 77ce4e6d-bf42-4614-a068-2309f1d685c5 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] snapshot_file for this snap is: volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[13869135-e6dd-482f-8b30-6e26c9f5777f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5de2b9-e6e7-40f6-a733-6d014d741229]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_s2gk9cx1 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:06 devstack quobyte-client[82625]: System call of process 98131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4" returned: 0 in 0.603s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77ce4e6d-bf42-4614-a068-2309f1d685c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:56:07 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeba710-95f7-4863-8dd6-b4118a675a5a]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_s2gk9cx1" returned: 0 in 0.549s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_s2gk9cx1 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5" returned: 0 in 0.564s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_s2gk9cx1" returned: 1 in 0.952s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36810fdd-7157-4a06-a4dd-33f26a5e8f64_s2gk9cx1' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4" returned: 0 in 0.526s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[110ab5ce-ad4d-4302-8a83-cc18b9e0353e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:08 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Flow 'volume_create_manager' (da452494-cfbe-425e-95dd-7f7b775229f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fe4c9f-dd4b-4d48-8690-5552c63ee9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fe4c9f-dd4b-4d48-8690-5552c63ee9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1388737368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191bbfb4-038d-4e72-b5c6-c0d8263853be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29faa4ceec0047db9a6d7604df4f4fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:08Z,use_quota=True,user_id='aaee48bd1810400383726939def533be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206f8ebf-3bde-43b8-a9d7-a7c06d88b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206f8ebf-3bde-43b8-a9d7-a7c06d88b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7411f2-947b-49ed-ac36-1500d5b91cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7411f2-947b-49ed-ac36-1500d5b91cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191bbfb4-038d-4e72-b5c6-c0d8263853be', 'volume_name': 'volume-191bbfb4-038d-4e72-b5c6-c0d8263853be', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075ef4b3-0e43-4afb-80ed-9561984807fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075ef4b3-0e43-4afb-80ed-9561984807fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5a0ba2-596f-4057-8dd0-e16e7c55df3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:08 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Volume 191bbfb4-038d-4e72-b5c6-c0d8263853be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191bbfb4-038d-4e72-b5c6-c0d8263853be', 'volume_size': 1} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1388737368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191bbfb4-038d-4e72-b5c6-c0d8263853be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29faa4ceec0047db9a6d7604df4f4fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:08Z,use_quota=True,user_id='aaee48bd1810400383726939def533be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Creating volume 191bbfb4-038d-4e72-b5c6-c0d8263853be {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:56:08 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5.86112b24-0fce-47f7-853f-13d7e9da31b4" returned: 0 in 0.747s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:09 devstack quobyte-client[82625]: System call of process 98148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:09 devstack quobyte-client[82625]: System call of process 98148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:09 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=98, name=volume-191bbfb4-038d-4e72-b5c6-c0d8263853be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] 36810fdd-7157-4a06-a4dd-33f26a5e8f64 was qcow2, converting to raw {{(pid=82609) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:09 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=97, name=volume-dec93750-3351-4394-874d-d47db3f4fa70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-quobyte-86112b24-0fce-47f7-853f-13d7e9da31b4" released by "_delete_snapshot" :: held 3.078s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-quobyte-77ce4e6d-bf42-4614-a068-2309f1d685c5" released by "delete_snapshot" :: held 3.240s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be 1073741824" returned: 0 in 0.728s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be" returned: 0 in 0.425s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] <== create_volume: return (1192ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5a0ba2-596f-4057-8dd0-e16e7c55df3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191bbfb4-038d-4e72-b5c6-c0d8263853be', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c5926c-82b7-4ee0-9812-34c93b24fb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:10 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Volume volume-191bbfb4-038d-4e72-b5c6-c0d8263853be (191bbfb4-038d-4e72-b5c6-c0d8263853be): created successfully Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c5926c-82b7-4ee0-9812-34c93b24fb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Flow 'volume_create_manager' (da452494-cfbe-425e-95dd-7f7b775229f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Created reservations ['aa029878-4fef-43cd-972a-9e1ba3079eae', '2f2d8554-726d-429b-88f3-43999d5b636f', 'abba9694-142f-4d87-a410-11ecfd742d33', '8f0f431e-2e7d-4584-a10f-3ccb27eb57da'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:10 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c2da7e27-a7ad-44f1-af44-59568520172e tempest-SnapshotMetadataTestJSON-1873200806 None] Created volume successfully. Sep 10 17:56:10 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Delete snapshot completed successfully. Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6df0dfe7-e102-46af-bf43-897d411d5e67 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-86112b24-0fce-47f7-853f-13d7e9da31b4-delete_snapshot" released by "delete_snapshot" :: held 4.349s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 0 in 1.486s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36810fdd-7157-4a06-a4dd-33f26a5e8f64_k2h11f_wdevstack@QuobyteHD, size 112.00 MB, duration 1.49 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:56:10 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Converted 112.00 MB image at 75.12 MB/s Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:10 devstack quobyte-client[82625]: System call of process 98167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 1G" returned: 0 in 0.120s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:11 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8686b7a-e12f-4304-af98-9501207c9999]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:11 devstack quobyte-client[82625]: System call of process 98170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "cinder-77ce4e6d-bf42-4614-a068-2309f1d685c5-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 0 in 0.789s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-77ce4e6d-bf42-4614-a068-2309f1d685c5-delete_volume" acquired by "delete_volume" :: waited 0.281s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:12 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Creating offline snapshot 857a3fa6-6053-4e43-98b4-f65a49b17a88 of volume 191bbfb4-038d-4e72-b5c6-c0d8263853be {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb64f4c-b31e-49c3-abe3-51e914c4513e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:12 devstack quobyte-client[82625]: System call of process 98172 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:12 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "cinder-quobyte-77ce4e6d-bf42-4614-a068-2309f1d685c5" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 1 in 0.955s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Downloaded image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 ((None, None)) to volume dec93750-3351-4394-874d-d47db3f4fa70 successfully. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Temporary image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 for user 0fc19cca831d45b59afaa09a75797111 is deleted. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Marking volume dec93750-3351-4394-874d-d47db3f4fa70 as bootable. {{(pid=82609) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Copying metadata from image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 to dec93750-3351-4394-874d-d47db3f4fa70. {{(pid=82609) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Creating volume glance metadata for volume dec93750-3351-4394-874d-d47db3f4fa70 backed by image 36810fdd-7157-4a06-a4dd-33f26a5e8f64 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82609) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-quobyte-77ce4e6d-bf42-4614-a068-2309f1d685c5" acquired by "delete_volume" :: waited 0.122s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c8306c-db44-4de8-b331-844fb1fab576]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be" returned: 0 in 0.960s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:13 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=99, name=volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5" returned: 0 in 0.653s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 1G" returned: 0 in 0.358s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): qemu-img rebase -u -b volume-191bbfb4-038d-4e72-b5c6-c0d8263853be -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:13 devstack quobyte-client[82625]: System call of process 98186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-77ce4e6d-bf42-4614-a068-2309f1d685c5" returned: 0 in 0.385s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "qemu-img rebase -u -b volume-191bbfb4-038d-4e72-b5c6-c0d8263853be -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88" returned: 0 in 0.345s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-quobyte-77ce4e6d-bf42-4614-a068-2309f1d685c5" released by "delete_volume" :: held 1.561s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c088873-e98f-474c-97ff-924fd9092a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec93750-3351-4394-874d-d47db3f4fa70', 'volume_size': 1, 'image_id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd18c22f2352b4163b825b859ec6d4f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36810fdd-7157-4a06-a4dd-33f26a5e8f64', 'created_at': datetime.datetime(2025, 9, 10, 15, 14, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36810fdd-7157-4a06-a4dd-33f26a5e8f64/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94c0652-36ee-44ef-975c-b5acf34aa40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88" returned: 0 in 0.439s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:56:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:14 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Volume volume-dec93750-3351-4394-874d-d47db3f4fa70 (dec93750-3351-4394-874d-d47db3f4fa70): created successfully Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94c0652-36ee-44ef-975c-b5acf34aa40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Flow 'volume_create_manager' (02ec6453-728f-45da-8394-1ec09f0ffbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88" returned: 0 in 0.490s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:15 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-71c24fcd-90fd-447d-a3b9-3f021a0e0dc7 tempest-VolumesExtendTest-779841382 None] Created volume successfully. Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.info" returned: 0 in 0.466s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.info" returned: 0 in 0.275s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.741s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.430s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:16 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbd5b1c-0f07-41cc-877c-e9bab0811d76]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:16 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Created reservations ['d22bbe87-3e27-4cea-9be8-4bdeaa7f9b12', '33e47596-2fd0-4103-b56f-19a098126f89', '5822a1ee-707d-45fa-a891-35d02c7354de', '7c4d1c26-8d8d-4731-9d08-a4e2114d4f15'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:16 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9cf60861-305e-450b-8d1e-32fe327b56cc tempest-SnapshotMetadataTestJSON-1873200806 None] Create snapshot completed successfully Sep 10 17:56:16 devstack quobyte-client[82625]: System call of process 98193 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 0 in 0.635s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "cinder-3b1e3402-9961-45e2-be16-906d8cfb9d32-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 1 in 1.422s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 2G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.818s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-3b1e3402-9961-45e2-be16-906d8cfb9d32-delete_volume" acquired by "delete_volume" :: waited 0.672s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "cinder-857a3fa6-6053-4e43-98b4-f65a49b17a88-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:18 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Deleted volume successfully. Sep 10 17:56:18 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "cinder-quobyte-3b1e3402-9961-45e2-be16-906d8cfb9d32" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-857a3fa6-6053-4e43-98b4-f65a49b17a88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.171s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:18 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "cinder-quobyte-191bbfb4-038d-4e72-b5c6-c0d8263853be" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 2G" returned: 0 in 0.795s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.989s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-52abfbb2-ccaf-427b-9dd6-d671e2892778 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-77ce4e6d-bf42-4614-a068-2309f1d685c5-delete_volume" released by "delete_volume" :: held 7.028s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-quobyte-191bbfb4-038d-4e72-b5c6-c0d8263853be" acquired by "delete_snapshot" :: waited 0.106s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "cinder-quobyte-857a3fa6-6053-4e43-98b4-f65a49b17a88" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-quobyte-3b1e3402-9961-45e2-be16-906d8cfb9d32" acquired by "delete_volume" :: waited 0.128s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2ba7218e-a011-4275-84ae-70ae0f276675 tempest-VolumesExtendTest-779841382 None] Extend volume completed successfully. Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e621dc-400a-4795-9ac0-4e1d5692f8be]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3b1e3402-9961-45e2-be16-906d8cfb9d32 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-quobyte-857a3fa6-6053-4e43-98b4-f65a49b17a88" acquired by "_delete_snapshot" :: waited 0.188s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Deleting offline snapshot 857a3fa6-6053-4e43-98b4-f65a49b17a88 of volume 191bbfb4-038d-4e72-b5c6-c0d8263853be {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] snapshot_file for this snap is: volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd46273-fc59-4a3d-8822-45e588621706]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3b1e3402-9961-45e2-be16-906d8cfb9d32" returned: 0 in 0.702s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3b1e3402-9961-45e2-be16-906d8cfb9d32 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:19 devstack quobyte-client[82625]: System call of process 98204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3b1e3402-9961-45e2-be16-906d8cfb9d32" returned: 0 in 0.164s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88" returned: 0 in 0.739s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-quobyte-3b1e3402-9961-45e2-be16-906d8cfb9d32" released by "delete_volume" :: held 1.063s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-191bbfb4-038d-4e72-b5c6-c0d8263853be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c6727f-994e-48c2-b897-80643ef47436]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Acquiring lock "cinder-dec93750-3351-4394-874d-d47db3f4fa70-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Lock "cinder-dec93750-3351-4394-874d-d47db3f4fa70-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:20 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Created reservations ['56ba8236-71c6-4729-97a3-988b71ad141b', 'e87497c8-c41d-4e22-bf8f-d56f14dc98ef', '505e600e-1cbe-4faa-839d-bd32fdf58595', '6e353fd9-04db-4628-a5fd-022fa72000aa'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Acquiring lock "cinder-quobyte-dec93750-3351-4394-874d-d47db3f4fa70" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be" returned: 0 in 0.728s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Lock "cinder-quobyte-dec93750-3351-4394-874d-d47db3f4fa70" acquired by "delete_volume" :: waited 0.159s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:21 devstack quobyte-client[82625]: System call of process 98213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebfca48-fb78-4300-a81b-f303ad081c9a]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88" returned: 0 in 0.633s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.366s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:21 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:56:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Deleted volume successfully. Sep 10 17:56:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be.857a3fa6-6053-4e43-98b4-f65a49b17a88" returned: 0 in 0.359s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-quobyte-857a3fa6-6053-4e43-98b4-f65a49b17a88" released by "_delete_snapshot" :: held 3.000s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-quobyte-191bbfb4-038d-4e72-b5c6-c0d8263853be" released by "delete_snapshot" :: held 3.213s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3773f6b4-bfea-44bd-9710-f14fa801e230 tempest-CinderUnicodeTest-153552093 None] Lock "cinder-3b1e3402-9961-45e2-be16-906d8cfb9d32-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:22 devstack quobyte-client[82625]: System call of process 98217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 0 in 0.778s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:22 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Created reservations ['133faa30-9b2c-439c-ab6f-f7075a4bb9a1', '7a6acf1f-84ad-41fb-add6-b4ce5957b1ce', '41c3afe5-fe14-4f8e-be1f-bd69448082ff', '7fc4fa15-ac92-491a-b349-4eafd5b56ce7'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 1 in 0.689s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:56:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:23 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Delete snapshot completed successfully. Sep 10 17:56:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-dec93750-3351-4394-874d-d47db3f4fa70" returned: 0 in 0.312s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-5cd40d27-09fa-4011-acb9-48373ed7ff42 tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-857a3fa6-6053-4e43-98b4-f65a49b17a88-delete_snapshot" released by "delete_snapshot" :: held 4.514s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Lock "cinder-quobyte-dec93750-3351-4394-874d-d47db3f4fa70" released by "delete_volume" :: held 2.258s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:23 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Created reservations ['fa07b3c9-3942-4654-953c-172cc02aadc8', '7faef278-5abc-4fb7-a401-d68794fc29a6', '0634d7da-fb23-47ec-bd1f-8cd86581f9c5', '431d753a-9413-4e1f-a21c-5be560a9cbc2'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "cinder-191bbfb4-038d-4e72-b5c6-c0d8263853be-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.311s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:56:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Deleted volume successfully. Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-191bbfb4-038d-4e72-b5c6-c0d8263853be-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-954744ef-f0b0-479d-9f74-bfe2802384b1 tempest-VolumesExtendTest-779841382 None] Lock "cinder-dec93750-3351-4394-874d-d47db3f4fa70-delete_volume" released by "delete_volume" :: held 3.761s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "cinder-quobyte-191bbfb4-038d-4e72-b5c6-c0d8263853be" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-quobyte-191bbfb4-038d-4e72-b5c6-c0d8263853be" acquired by "delete_volume" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[760fbfbd-9534-47c1-8706-83e8938d7dd0]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:25 devstack quobyte-client[82625]: System call of process 98227 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be" returned: 0 in 0.608s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-191bbfb4-038d-4e72-b5c6-c0d8263853be" returned: 0 in 0.161s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-quobyte-191bbfb4-038d-4e72-b5c6-c0d8263853be" released by "delete_volume" :: held 1.249s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:26 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Flow 'volume_create_manager' (4fe99969-1248-4873-a85d-64527c1f7ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4853ed3b-01ec-4c7b-858a-7509478a24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4853ed3b-01ec-4c7b-858a-7509478a24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1397914486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184a93c3-52e2-401d-9488-d0e29d989335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32455874977f4c72ab81517bf28fdacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:26Z,use_quota=True,user_id='0fc19cca831d45b59afaa09a75797111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b37ccc7-f3d1-4e6c-a8df-1c08f0b0b56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b37ccc7-f3d1-4e6c-a8df-1c08f0b0b56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee8ad27-2c0c-41f2-a64f-c3f5bd24a918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee8ad27-2c0c-41f2-a64f-c3f5bd24a918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184a93c3-52e2-401d-9488-d0e29d989335', 'volume_name': 'volume-184a93c3-52e2-401d-9488-d0e29d989335', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5522aed-0f0f-4392-97b4-3d4187b04af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5522aed-0f0f-4392-97b4-3d4187b04af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e8d310-991d-44eb-8e14-304349e3720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:26 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Volume 184a93c3-52e2-401d-9488-d0e29d989335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184a93c3-52e2-401d-9488-d0e29d989335', 'volume_size': 1} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1397914486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184a93c3-52e2-401d-9488-d0e29d989335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32455874977f4c72ab81517bf28fdacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:26Z,use_quota=True,user_id='0fc19cca831d45b59afaa09a75797111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Creating volume 184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:56:26 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:26 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=101, name=volume-184a93c3-52e2-401d-9488-d0e29d989335, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Created reservations ['2801be90-8575-49a8-a100-af6cc35c5b90', '0ee1baf7-7d21-41a6-a718-a84b67491e1a', '31efee41-110f-4222-9701-653bf81be787', 'dad5b42b-7c03-4ebc-8c04-de423f9abc64'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 1073741824" returned: 0 in 0.560s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335" returned: 0 in 0.443s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] <== create_volume: return (1038ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e8d310-991d-44eb-8e14-304349e3720f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184a93c3-52e2-401d-9488-d0e29d989335', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e87884-3338-4d9b-8447-c0cfd3f00177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:27 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Volume volume-184a93c3-52e2-401d-9488-d0e29d989335 (184a93c3-52e2-401d-9488-d0e29d989335): created successfully Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e87884-3338-4d9b-8447-c0cfd3f00177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Flow 'volume_create_manager' (4fe99969-1248-4873-a85d-64527c1f7ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.742s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:56:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b3287e18-6598-47c4-8c1f-d9fbc812704a tempest-VolumesExtendTest-779841382 None] Created volume successfully. Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.407s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:56:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Deleted volume successfully. Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cd1f1a38-3b27-4ad8-8e43-17c39d02a50d tempest-SnapshotMetadataTestJSON-1873200806 None] Lock "cinder-191bbfb4-038d-4e72-b5c6-c0d8263853be-delete_volume" released by "delete_volume" :: held 4.094s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:28 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Creating offline snapshot 3b2b763a-fc6f-4f90-9861-4451e0a991a9 of volume 184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:56:29 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e42c442-1848-44de-b059-79b4a6991f25]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335" returned: 0 in 0.526s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:29 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=102, name=volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 1G" returned: 0 in 0.299s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img rebase -u -b volume-184a93c3-52e2-401d-9488-d0e29d989335 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:30 devstack quobyte-client[82625]: System call of process 98243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] CMD "qemu-img rebase -u -b volume-184a93c3-52e2-401d-9488-d0e29d989335 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9" returned: 0 in 0.298s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9" returned: 0 in 0.223s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9" returned: 0 in 0.131s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.info" returned: 0 in 0.123s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.info" returned: 0 in 0.124s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:31 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f7b73a2a-b10a-4949-a736-d0ee11e01106 tempest-VolumesExtendTest-779841382 None] Create snapshot completed successfully Sep 10 17:56:32 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:32 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c56d6c-0847-4002-9fc3-90e1d552022b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335" returned: 0 in 0.484s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 2G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:33 devstack quobyte-client[82625]: System call of process 98253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 2G" returned: 0 in 0.281s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.868s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:33 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b6c614f9-c3fb-44f5-ac74-7425ae83bf19 tempest-VolumesExtendTest-779841382 None] Extend volume completed successfully. Sep 10 17:56:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Acquiring lock "cinder-3b2b763a-fc6f-4f90-9861-4451e0a991a9-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Lock "cinder-3b2b763a-fc6f-4f90-9861-4451e0a991a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:35 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Acquiring lock "cinder-quobyte-184a93c3-52e2-401d-9488-d0e29d989335" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Lock "cinder-quobyte-184a93c3-52e2-401d-9488-d0e29d989335" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Acquiring lock "cinder-quobyte-3b2b763a-fc6f-4f90-9861-4451e0a991a9" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Lock "cinder-quobyte-3b2b763a-fc6f-4f90-9861-4451e0a991a9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Deleting offline snapshot 3b2b763a-fc6f-4f90-9861-4451e0a991a9 of volume 184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] snapshot_file for this snap is: volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c29b5-eac4-40bf-9de9-1d8e77493523]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9" returned: 0 in 0.747s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-184a93c3-52e2-401d-9488-d0e29d989335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:56:36 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6df620-d3af-4171-b7cf-1bd176649397]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:36 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:56:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Flow 'volume_create_manager' (32aecf0a-cb0b-4d59-82c6-7b80a17d197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b46544-cf8c-470f-b4cc-a7bd95679bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:36 devstack quobyte-client[82625]: System call of process 98260 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b46544-cf8c-470f-b4cc-a7bd95679bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-856620201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e386251cf044bf8c1ee3958b36e921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:35Z,use_quota=True,user_id='2ca8feaf7b954462ae4a98bc4d595e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b14d71-2b2c-4ac3-ad66-c7483117451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b14d71-2b2c-4ac3-ad66-c7483117451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30c097b-63b8-4a08-b738-bc464e74f864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30c097b-63b8-4a08-b738-bc464e74f864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7', 'volume_name': 'volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e969e850-9908-4233-9c92-cdb0739b45f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e969e850-9908-4233-9c92-cdb0739b45f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f951c488-3a1b-4f12-b928-777dd9c4f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:37 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Volume 4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7', 'volume_size': 1} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-856620201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e386251cf044bf8c1ee3958b36e921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:35Z,use_quota=True,user_id='2ca8feaf7b954462ae4a98bc4d595e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Creating volume 4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:56:37 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:37 devstack quobyte-client[82625]: System call of process 98263 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:37 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=104, name=volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335" returned: 0 in 1.256s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7 1073741824" returned: 0 in 0.544s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7" returned: 0 in 0.148s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] <== create_volume: return (801ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:56:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9" returned: 0 in 0.705s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f951c488-3a1b-4f12-b928-777dd9c4f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e3c010-f5c3-4a54-ab1c-6b71faf9d910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335.3b2b763a-fc6f-4f90-9861-4451e0a991a9" returned: 0 in 0.432s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:38 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Volume volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7 (4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7): created successfully Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e3c010-f5c3-4a54-ab1c-6b71faf9d910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Flow 'volume_create_manager' (32aecf0a-cb0b-4d59-82c6-7b80a17d197c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Lock "cinder-quobyte-3b2b763a-fc6f-4f90-9861-4451e0a991a9" released by "_delete_snapshot" :: held 3.512s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:38 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8d7f1be8-dcba-437c-b1db-94b16bdeb2ff tempest-VolumesTransfersTest-417914485 None] Created volume successfully. Sep 10 17:56:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Lock "cinder-quobyte-184a93c3-52e2-401d-9488-d0e29d989335" released by "delete_snapshot" :: held 3.607s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:39 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Created reservations ['45630b9d-35ee-4d3e-b7fe-1fd72e0408a0', '97eb86f6-71ee-443e-aebd-5b1dc860960e', '2b5f6fb4-c319-449f-9156-8c6b500f28ec', 'd003ceeb-cb29-4da6-8863-a207c07a8a4a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Delete snapshot completed successfully. Sep 10 17:56:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-76652023-80d8-4ab8-9003-e1b0bc90ee86 tempest-VolumesExtendTest-779841382 None] Lock "cinder-3b2b763a-fc6f-4f90-9861-4451e0a991a9-delete_snapshot" released by "delete_snapshot" :: held 4.364s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-75abaeb7-f98d-4d97-97e4-ba12d2106c9c tempest-VolumesTransfersTest-687819746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:40 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-75abaeb7-f98d-4d97-97e4-ba12d2106c9c tempest-VolumesTransfersTest-687819746 None] Transfer volume completed successfully. Sep 10 17:56:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Acquiring lock "cinder-184a93c3-52e2-401d-9488-d0e29d989335-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Lock "cinder-184a93c3-52e2-401d-9488-d0e29d989335-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Acquiring lock "cinder-quobyte-184a93c3-52e2-401d-9488-d0e29d989335" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Lock "cinder-quobyte-184a93c3-52e2-401d-9488-d0e29d989335" acquired by "delete_volume" :: waited 0.014s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:40 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda7eec-6003-42e9-b70b-261e27c94ba5]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335" returned: 0 in 0.633s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-184a93c3-52e2-401d-9488-d0e29d989335" returned: 0 in 0.119s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Lock "cinder-quobyte-184a93c3-52e2-401d-9488-d0e29d989335" released by "delete_volume" :: held 0.962s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Acquiring lock "cinder-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Lock "cinder-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:42 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Created reservations ['af46960a-cd4a-41b0-9ca7-ef56d8a9cf0e', '8c4d4430-54c6-4857-b426-2267f5aa1591', 'c0755b97-054a-4515-b31b-251664d9f93e', 'c104f447-4ec4-4d63-9652-7c2e006145c3'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:42 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Acquiring lock "cinder-quobyte-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Lock "cinder-quobyte-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7" acquired by "delete_volume" :: waited 0.025s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:42 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed162610-6aee-497c-8df2-827a70d0a358]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7" returned: 0 in 0.758s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7" returned: 0 in 0.455s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Lock "cinder-quobyte-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7" released by "delete_volume" :: held 1.486s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.435s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:43 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:56:43 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Deleted volume successfully. Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-64975124-0408-4c27-9cfb-b58675919659 tempest-VolumesExtendTest-779841382 None] Lock "cinder-184a93c3-52e2-401d-9488-d0e29d989335-delete_volume" released by "delete_volume" :: held 3.561s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Created reservations ['5ec557c0-7bf5-4846-838a-3f8bb6d1adfa', 'eb56c295-0c2a-4690-b028-04021da1cf0b', 'ca4d515a-7fcb-4e2c-921d-d6f441da3756', 'eb795190-0795-4924-81c8-0ff02afa35a2'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.196s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:44 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:56:44 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Deleted volume successfully. Sep 10 17:56:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-61b8a2df-e15f-466e-bbc3-a92f9659e028 tempest-VolumesTransfersTest-1592501631 None] Lock "cinder-4eb11a5f-3b89-4716-b6ef-ff0680d7f6d7-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:46 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Flow 'volume_create_manager' (08b88f62-30d3-4cd5-9d73-d1cf15c21724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3229847-c7cd-45b6-86b9-9d18176babae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3229847-c7cd-45b6-86b9-9d18176babae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-244863013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ad28de-3bc6-4060-9ab8-be363562a485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e386251cf044bf8c1ee3958b36e921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:46Z,use_quota=True,user_id='2ca8feaf7b954462ae4a98bc4d595e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102faa9b-f126-4ec8-840d-5509395f5654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102faa9b-f126-4ec8-840d-5509395f5654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7371b95-de38-4d85-ad37-099e62ce39c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7371b95-de38-4d85-ad37-099e62ce39c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ad28de-3bc6-4060-9ab8-be363562a485', 'volume_name': 'volume-03ad28de-3bc6-4060-9ab8-be363562a485', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aec4912-c907-4659-9b8b-67eb96a73803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aec4912-c907-4659-9b8b-67eb96a73803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c885f7f-cbc7-46ef-88ec-d7a9393a8815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:46 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Volume 03ad28de-3bc6-4060-9ab8-be363562a485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ad28de-3bc6-4060-9ab8-be363562a485', 'volume_size': 1} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-244863013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ad28de-3bc6-4060-9ab8-be363562a485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e386251cf044bf8c1ee3958b36e921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:46Z,use_quota=True,user_id='2ca8feaf7b954462ae4a98bc4d595e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Creating volume 03ad28de-3bc6-4060-9ab8-be363562a485 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:56:46 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:56:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03ad28de-3bc6-4060-9ab8-be363562a485 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:47 devstack quobyte-client[82625]: System call of process 98284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:47 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=105, name=volume-03ad28de-3bc6-4060-9ab8-be363562a485, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03ad28de-3bc6-4060-9ab8-be363562a485 1073741824" returned: 0 in 0.662s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03ad28de-3bc6-4060-9ab8-be363562a485 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03ad28de-3bc6-4060-9ab8-be363562a485" returned: 0 in 0.128s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] <== create_volume: return (878ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:56:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c885f7f-cbc7-46ef-88ec-d7a9393a8815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ad28de-3bc6-4060-9ab8-be363562a485', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083fd6fd-1a61-48dd-aeff-973ee5ebd135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Volume volume-03ad28de-3bc6-4060-9ab8-be363562a485 (03ad28de-3bc6-4060-9ab8-be363562a485): created successfully Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083fd6fd-1a61-48dd-aeff-973ee5ebd135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Flow 'volume_create_manager' (08b88f62-30d3-4cd5-9d73-d1cf15c21724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4f388354-cfd8-48c0-ad60-387d9870aa04 tempest-VolumesTransfersTest-417914485 None] Created volume successfully. Sep 10 17:56:48 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Flow 'volume_create_manager' (7d3dd1f9-bdb6-4f13-94db-42726c31f1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d82c432-8de2-4538-b8c3-9a8277d39ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d82c432-8de2-4538-b8c3-9a8277d39ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1188505403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da26344-f0ed-49c9-a8a7-17d5ada279e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe9d37d7abe4441bb95caaf1c2bf2d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:48Z,use_quota=True,user_id='64c560a92ed64e3f8fbd7d4327ea4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90c273b-bdb4-4085-94fa-395e5e7d9610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90c273b-bdb4-4085-94fa-395e5e7d9610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d29427-3765-4f14-9562-fd658d4317bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d29427-3765-4f14-9562-fd658d4317bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da26344-f0ed-49c9-a8a7-17d5ada279e4', 'volume_name': 'volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59b006d-00d9-4747-a052-ed8477dc77e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59b006d-00d9-4747-a052-ed8477dc77e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf09412-0e79-4d32-bd6b-f5502d9f4a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume 2da26344-f0ed-49c9-a8a7-17d5ada279e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4', 'volume_size': 1} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1188505403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da26344-f0ed-49c9-a8a7-17d5ada279e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe9d37d7abe4441bb95caaf1c2bf2d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:56:48Z,use_quota=True,user_id='64c560a92ed64e3f8fbd7d4327ea4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Creating volume 2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:56:48 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:56:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:49 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=106, name=volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Acquiring lock "cinder-03ad28de-3bc6-4060-9ab8-be363562a485-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 1073741824" returned: 0 in 0.760s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Lock "cinder-03ad28de-3bc6-4060-9ab8-be363562a485-delete_volume" acquired by "delete_volume" :: waited 0.376s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4" returned: 0 in 0.471s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] <== create_volume: return (1256ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf09412-0e79-4d32-bd6b-f5502d9f4a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0c0c59-05ae-4d60-898e-6e86ea53921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:56:50 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Acquiring lock "cinder-quobyte-03ad28de-3bc6-4060-9ab8-be363562a485" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:56:50 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 (2da26344-f0ed-49c9-a8a7-17d5ada279e4): created successfully Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0c0c59-05ae-4d60-898e-6e86ea53921e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Flow 'volume_create_manager' (7d3dd1f9-bdb6-4f13-94db-42726c31f1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Lock "cinder-quobyte-03ad28de-3bc6-4060-9ab8-be363562a485" acquired by "delete_volume" :: waited 0.128s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:56:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3fdb817f-b72b-43f5-8783-f19149a3b3c9 tempest-VolumesSnapshotListTestJSON-211860661 None] Created volume successfully. Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca8eb0-3c04-479f-8225-d424d7ea43eb]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03ad28de-3bc6-4060-9ab8-be363562a485 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03ad28de-3bc6-4060-9ab8-be363562a485" returned: 0 in 1.306s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03ad28de-3bc6-4060-9ab8-be363562a485 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:52 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Creating offline snapshot d5a1605f-6458-4139-bd32-6f53ebac966b of volume 2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:56:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-03ad28de-3bc6-4060-9ab8-be363562a485" returned: 0 in 0.574s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:52 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c461cf3-f5fa-41c4-8f0e-1669421fb6a5]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:52 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Lock "cinder-quobyte-03ad28de-3bc6-4060-9ab8-be363562a485" released by "delete_volume" :: held 2.180s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Created reservations ['c760cbd6-72e6-46a0-a493-497d3077e6d0', 'ab016ab5-8a04-4a64-a81e-abd2582a3eea', '58fa9cf9-8667-4497-8aae-310afea67ec4', '00e011ab-1b9e-4407-880b-d72a6f6c5447'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:56:53 devstack quobyte-client[82625]: System call of process 98328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4" returned: 0 in 0.778s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:53 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=107, name=volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.043s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b 1G" returned: 0 in 0.591s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.270s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:54 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:56:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Deleted volume successfully. Sep 10 17:56:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img rebase -u -b volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b" returned: 0 in 0.721s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1dc3e474-dc87-4c93-83c2-6916aa01ccb9 tempest-VolumesTransfersTest-1592501631 None] Lock "cinder-03ad28de-3bc6-4060-9ab8-be363562a485-delete_volume" released by "delete_volume" :: held 5.419s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b" returned: 0 in 0.592s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b" returned: 0 in 0.126s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.info" returned: 0 in 0.134s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.info" returned: 0 in 0.132s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.593s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:55 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=104,cinder:SELECT=65,cinder:INSERT=29,cinder:DELETE=9 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:56:56 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=82,cinder:UPDATE=94,cinder:DELETE=9,cinder:INSERT=24 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:56:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b3a6630e-8eb0-4ae1-b39d-6f434b05e094 tempest-VolumesSnapshotListTestJSON-211860661 None] Create snapshot completed successfully Sep 10 17:56:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:56:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:56:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:56:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Creating offline snapshot a8650b1c-e1f9-4ebe-9004-094048f1e5e2 of volume 2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:56:57 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[462539c3-dae0-45dd-bd45-8e6cf28638c5]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:56:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b" returned: 0 in 0.558s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:58 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=109, name=volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 1G" returned: 0 in 0.343s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img rebase -u -b volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2" returned: 0 in 0.191s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2" returned: 0 in 0.160s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:56:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:56:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2" returned: 0 in 0.135s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:56:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:56:59 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-73b51bfd-d366-46e6-84fb-3067c585f443 tempest-VolumesSnapshotListTestJSON-211860661 None] Create snapshot completed successfully Sep 10 17:57:00 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Flow 'volume_create_manager' (b0547409-b4e3-4616-95fb-93e23c2b16d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5df2f4-8646-48cd-997d-6874cbb50423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5df2f4-8646-48cd-997d-6874cbb50423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1686916486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ba1444-7026-4031-b70e-56775c35a13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a589042e42480d872fc776342a6f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:00Z,use_quota=True,user_id='95b023265aef4b148ff1e8185f9483e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cdeda1-07f1-4676-a518-57b167488d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cdeda1-07f1-4676-a518-57b167488d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83598e2c-5b9f-4e4e-a893-5ac8e7c2e02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83598e2c-5b9f-4e4e-a893-5ac8e7c2e02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ba1444-7026-4031-b70e-56775c35a13c', 'volume_name': 'volume-97ba1444-7026-4031-b70e-56775c35a13c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035d14c7-ffa0-4211-9d7e-fd525745c4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035d14c7-ffa0-4211-9d7e-fd525745c4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d967229-08cb-4982-9b27-0d134d1262b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:00 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Volume 97ba1444-7026-4031-b70e-56775c35a13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ba1444-7026-4031-b70e-56775c35a13c', 'volume_size': 1} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1686916486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ba1444-7026-4031-b70e-56775c35a13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a589042e42480d872fc776342a6f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:00Z,use_quota=True,user_id='95b023265aef4b148ff1e8185f9483e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Creating volume 97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:57:00 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:57:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:00 devstack quobyte-client[82625]: System call of process 98355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:00 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=110, name=volume-97ba1444-7026-4031-b70e-56775c35a13c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:01 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c 1073741824" returned: 0 in 0.480s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c" returned: 0 in 0.120s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] <== create_volume: return (643ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.343s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d967229-08cb-4982-9b27-0d134d1262b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ba1444-7026-4031-b70e-56775c35a13c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f7c075-bcf7-471e-925f-3d06ec87f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Creating offline snapshot 03a8bec7-68a6-4171-b3fa-a030fb6fd934 of volume 2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:57:01 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Volume volume-97ba1444-7026-4031-b70e-56775c35a13c (97ba1444-7026-4031-b70e-56775c35a13c): created successfully Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f7c075-bcf7-471e-925f-3d06ec87f961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Flow 'volume_create_manager' (b0547409-b4e3-4616-95fb-93e23c2b16d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[595cec96-96c4-44fc-ade8-bf46476e9a05]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:02 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-dc32442b-9a49-49dd-a92a-344e676cfb3d tempest-SnapshotDependencyTests-1326249707 None] Created volume successfully. Sep 10 17:57:02 devstack quobyte-client[82625]: System call of process 98359 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2" returned: 0 in 0.516s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:57:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:02 devstack quobyte-client[82625]: System call of process 98363 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:02 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=111, name=volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 1G" returned: 0 in 0.385s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:02 devstack quobyte-client[82625]: System call of process 98366 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img rebase -u -b volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934" returned: 0 in 0.166s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:57:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934" returned: 0 in 0.109s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934" returned: 0 in 0.134s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.763s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:03 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-871b5636-215e-4856-b4b6-332873091131 tempest-VolumesSnapshotListTestJSON-211860661 None] Create snapshot completed successfully Sep 10 17:57:03 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Creating offline snapshot 0485e34c-d703-46f4-b1a7-6adbaa62b5ff of volume 97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc0ce3d-6177-45fb-9936-494a451b0a02]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:04 devstack quobyte-client[82625]: System call of process 98372 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c" returned: 0 in 0.911s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:05 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=112, name=volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff 1G" returned: 0 in 0.539s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): qemu-img rebase -u -b volume-97ba1444-7026-4031-b70e-56775c35a13c -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:05 devstack quobyte-client[82625]: System call of process 98378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] CMD "qemu-img rebase -u -b volume-97ba1444-7026-4031-b70e-56775c35a13c -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff" returned: 0 in 0.422s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:57:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-03a8bec7-68a6-4171-b3fa-a030fb6fd934-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff" returned: 0 in 0.478s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-03a8bec7-68a6-4171-b3fa-a030fb6fd934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.245s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:06 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:06 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Flow 'volume_create_manager' (d78392e3-5ca3-4534-be5a-694e132598d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dd828b-2aa8-4737-a5b4-cb2908e57fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff" returned: 0 in 0.444s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" acquired by "delete_snapshot" :: waited 0.383s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-quobyte-03a8bec7-68a6-4171-b3fa-a030fb6fd934" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dd828b-2aa8-4737-a5b4-cb2908e57fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1367114717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec65618-7648-45c0-91b2-117175e689dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7624a98f45cd4ef79740b6d8c37c957d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:06Z,use_quota=True,user_id='740772f5c6804d84bb8ec7addfe23a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cae9275-146f-4a7e-abff-d3dcf74342f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cae9275-146f-4a7e-abff-d3dcf74342f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78dcbb-826a-4137-b748-d6c8f0adeea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78dcbb-826a-4137-b748-d6c8f0adeea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec65618-7648-45c0-91b2-117175e689dc', 'volume_name': 'volume-0ec65618-7648-45c0-91b2-117175e689dc', 'volume_size': 2}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d2df0a-4d36-4357-9e22-d49e55bd72a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d2df0a-4d36-4357-9e22-d49e55bd72a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1036c144-be17-4586-bbe7-7feaf88daba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:07 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Volume 0ec65618-7648-45c0-91b2-117175e689dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec65618-7648-45c0-91b2-117175e689dc', 'volume_size': 2} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.info" returned: 0 in 0.331s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-03a8bec7-68a6-4171-b3fa-a030fb6fd934" acquired by "_delete_snapshot" :: waited 0.288s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Deleting offline snapshot 03a8bec7-68a6-4171-b3fa-a030fb6fd934 of volume 2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] snapshot_file for this snap is: volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[365412fe-a498-4036-bd04-6ec433f0743a]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.info" returned: 0 in 0.259s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.738s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1367114717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec65618-7648-45c0-91b2-117175e689dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7624a98f45cd4ef79740b6d8c37c957d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:06Z,use_quota=True,user_id='740772f5c6804d84bb8ec7addfe23a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Creating volume 0ec65618-7648-45c0-91b2-117175e689dc {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:57:07 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:57:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0ec65618-7648-45c0-91b2-117175e689dc 2147483648 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:07 devstack quobyte-client[82625]: System call of process 98386 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:07 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=114, name=volume-0ec65618-7648-45c0-91b2-117175e689dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934" returned: 0 in 0.725s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e7f7e2-7f08-4917-b636-81450c483d1c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:08 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-21ebd549-4513-4f73-bcbe-9b5f103a0379 tempest-SnapshotDependencyTests-1326249707 None] Create snapshot completed successfully Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0ec65618-7648-45c0-91b2-117175e689dc 2147483648" returned: 0 in 0.787s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0ec65618-7648-45c0-91b2-117175e689dc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0ec65618-7648-45c0-91b2-117175e689dc" returned: 0 in 0.161s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] <== create_volume: return (1003ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2" returned: 0 in 0.629s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1036c144-be17-4586-bbe7-7feaf88daba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec65618-7648-45c0-91b2-117175e689dc', 'volume_size': 2}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4b33f1-1bbf-4988-93c2-0dc24ae24bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:09 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Volume volume-0ec65618-7648-45c0-91b2-117175e689dc (0ec65618-7648-45c0-91b2-117175e689dc): created successfully Sep 10 17:57:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4b33f1-1bbf-4988-93c2-0dc24ae24bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Flow 'volume_create_manager' (d78392e3-5ca3-4534-be5a-694e132598d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934" returned: 0 in 0.435s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:09 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2f73d19d-8ffd-44f0-bcd7-e065a8623f1d tempest-VolumesCloneNegativeTest-1546798341 None] Created volume successfully. Sep 10 17:57:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.03a8bec7-68a6-4171-b3fa-a030fb6fd934" returned: 0 in 0.231s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-03a8bec7-68a6-4171-b3fa-a030fb6fd934" released by "_delete_snapshot" :: held 2.295s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" released by "delete_snapshot" :: held 2.621s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Created reservations ['056ef942-8e15-4472-b2a6-e58631ec78af', 'ea5dcb90-90c0-4f6a-abf3-892ff61ca78d', 'b1296e79-accb-4c08-8af3-0787cda38996', '669348e6-c0fa-4294-afc9-d4af5750b02b'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:57:10 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Delete snapshot completed successfully. Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c82af601-44b4-4241-8d90-76f2531dcaa8 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-03a8bec7-68a6-4171-b3fa-a030fb6fd934-delete_snapshot" released by "delete_snapshot" :: held 4.268s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:10 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Flow 'volume_create_manager' (879b2bfe-54c6-4de6-b320-ceb1da736218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfabaa70-8727-49ee-8ad5-6de26f36daa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfabaa70-8727-49ee-8ad5-6de26f36daa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a589042e42480d872fc776342a6f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0485e34c-d703-46f4-b1a7-6adbaa62b5ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:10Z,use_quota=True,user_id='95b023265aef4b148ff1e8185f9483e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4d0dd6-d2af-4373-8109-50dfe5007678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4d0dd6-d2af-4373-8109-50dfe5007678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3296ad4f-58be-4f2f-8a9c-b8bc735b2e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3296ad4f-58be-4f2f-8a9c-b8bc735b2e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b', 'volume_name': 'volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b', 'volume_size': 1, 'snapshot_id': '0485e34c-d703-46f4-b1a7-6adbaa62b5ff'}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0e41f8-5e0a-48a5-bd50-38b205f442ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0e41f8-5e0a-48a5-bd50-38b205f442ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e01843-be35-40d4-bd40-a76f0bf783a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:10 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Volume 2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b', 'volume_size': 1, 'snapshot_id': '0485e34c-d703-46f4-b1a7-6adbaa62b5ff'} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-quobyte-0485e34c-d703-46f4-b1a7-6adbaa62b5ff-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" by "_create_volume_from_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-0485e34c-d703-46f4-b1a7-6adbaa62b5ff-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Creating volume 2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b from snapshot 0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-quobyte-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" by "_copy_volume_from_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] snapshot: 0485e34c-d703-46f4-b1a7-6adbaa62b5ff, volume: 2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b, {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[151465a2-e3ea-4dba-bfb0-ac0097ccffc3]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Acquiring lock "cinder-0ec65618-7648-45c0-91b2-117175e689dc-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Lock "cinder-0ec65618-7648-45c0-91b2-117175e689dc-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-a8650b1c-e1f9-4ebe-9004-094048f1e5e2-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff" returned: 0 in 0.591s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ba1444-7026-4031-b70e-56775c35a13c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Creating direct copy from snapshot {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-a8650b1c-e1f9-4ebe-9004-094048f1e5e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:11 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b5b104-dd58-4b81-919e-db925cb92cc1]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" acquired by "delete_snapshot" :: waited 0.220s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-quobyte-a8650b1c-e1f9-4ebe-9004-094048f1e5e2" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-a8650b1c-e1f9-4ebe-9004-094048f1e5e2" acquired by "_delete_snapshot" :: waited 0.192s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Deleting offline snapshot a8650b1c-e1f9-4ebe-9004-094048f1e5e2 of volume 2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] snapshot_file for this snap is: volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:57:12 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Acquiring lock "cinder-quobyte-0ec65618-7648-45c0-91b2-117175e689dc" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1709210c-b0c8-486a-ac0e-07ddc83c07ea]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c" returned: 0 in 0.687s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.utils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b not found in is_blk_device check {{(pid=82609) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Lock "cinder-quobyte-0ec65618-7648-45c0-91b2-117175e689dc" acquired by "delete_volume" :: waited 0.373s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af08cd0-a5c6-45e7-a99c-45ace392a20c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0ec65618-7648-45c0-91b2-117175e689dc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:12 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=115, name=volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:12 devstack quobyte-client[82625]: System call of process 98409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2" returned: 0 in 0.655s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:57:13 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c90dd6-8878-44e3-b184-3e4b4b49651c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:14 devstack quobyte-client[82625]: System call of process 98415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0ec65618-7648-45c0-91b2-117175e689dc" returned: 0 in 1.670s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0ec65618-7648-45c0-91b2-117175e689dc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:14 devstack quobyte-client[82625]: System call of process 98426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-0ec65618-7648-45c0-91b2-117175e689dc" returned: 0 in 0.513s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b" returned: 0 in 2.050s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:57:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:15 devstack quobyte-client[82625]: System call of process 98432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:15 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Lock "cinder-quobyte-0ec65618-7648-45c0-91b2-117175e689dc" released by "delete_volume" :: held 3.241s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2" returned: 0 in 1.039s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.a8650b1c-e1f9-4ebe-9004-094048f1e5e2" returned: 0 in 1.150s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-a8650b1c-e1f9-4ebe-9004-094048f1e5e2" released by "_delete_snapshot" :: held 5.554s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" released by "delete_snapshot" :: held 5.821s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:19 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Created reservations ['8844c8d7-25fc-4f92-9e9c-3acd27d9657a', 'e113a43f-4dc0-4866-a922-e20036089c1c', '38ef988b-bfd8-4759-997e-931d904f710f', 'dda61c2a-73de-42ec-8ee4-e02fb838ac10'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:57:20 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Created reservations ['0c36edb6-94da-4fe5-b56e-382df2f58fe8', 'e69ee43b-791a-4959-af08-32ae74edd8f1', 'ebfa9b29-3b4e-45b5-9d71-ae0d12b56253', 'd396148c-83a1-4376-a787-6d4e8d5cb623'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" returned: 0 in 8.753s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acf9a98-698a-44c9-9926-ab7a9c67ce0b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.185s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-d5a1605f-6458-4139-bd32-6f53ebac966b-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Deleted volume successfully. Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c" returned: 0 in 1.146s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:57:22 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Converted 1024.00 MB image at 116.89 MB/s Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-d5a1605f-6458-4139-bd32-6f53ebac966b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.274s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:22 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Delete snapshot completed successfully. Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" returned: 0 in 0.377s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d3951e23-0273-4d64-a5d2-5ea09bb8b851 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-a8650b1c-e1f9-4ebe-9004-094048f1e5e2-delete_snapshot" released by "delete_snapshot" :: held 11.088s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" released by "_copy_volume_from_snapshot" :: held 11.798s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" acquired by "delete_snapshot" :: waited 0.221s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-quobyte-d5a1605f-6458-4139-bd32-6f53ebac966b" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-0485e34c-d703-46f4-b1a7-6adbaa62b5ff-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" released by "_create_volume_from_snapshot" :: held 11.833s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.849s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-d5a1605f-6458-4139-bd32-6f53ebac966b" acquired by "_delete_snapshot" :: waited 0.212s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Deleting offline snapshot d5a1605f-6458-4139-bd32-6f53ebac966b of volume 2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] snapshot_file for this snap is: volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a1c5d-41c7-461d-a588-0cdeef18abc1]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b2d8bb9f-e8ed-4aa2-9db6-c9b5158b1653 tempest-VolumesCloneNegativeTest-1546798341 None] Lock "cinder-0ec65618-7648-45c0-91b2-117175e689dc-delete_volume" released by "delete_volume" :: held 11.990s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b" returned: 0 in 0.531s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e01843-be35-40d4-bd40-a76f0bf783a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b', 'volume_size': 1, 'snapshot_id': '0485e34c-d703-46f4-b1a7-6adbaa62b5ff'}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66c48d4-03aa-40e9-ad71-de412a84893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f76750e-4941-4555-a4cc-5d29de372fcd]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:24 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Volume volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b (2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b): created successfully Sep 10 17:57:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66c48d4-03aa-40e9-ad71-de412a84893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Flow 'volume_create_manager' (879b2bfe-54c6-4de6-b320-ceb1da736218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4" returned: 0 in 0.665s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-393527c8-8a8e-47a0-abcf-2428876d7c17 tempest-SnapshotDependencyTests-1326249707 None] Created volume successfully. Sep 10 17:57:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b" returned: 0 in 0.333s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4.d5a1605f-6458-4139-bd32-6f53ebac966b" returned: 0 in 0.189s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-0485e34c-d703-46f4-b1a7-6adbaa62b5ff-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-d5a1605f-6458-4139-bd32-6f53ebac966b" released by "_delete_snapshot" :: held 2.257s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" released by "delete_snapshot" :: held 2.494s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-0485e34c-d703-46f4-b1a7-6adbaa62b5ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.284s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:25 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-quobyte-97ba1444-7026-4031-b70e-56775c35a13c" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-97ba1444-7026-4031-b70e-56775c35a13c" acquired by "delete_snapshot" :: waited 0.099s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-quobyte-0485e34c-d703-46f4-b1a7-6adbaa62b5ff" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-0485e34c-d703-46f4-b1a7-6adbaa62b5ff" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Deleting offline snapshot 0485e34c-d703-46f4-b1a7-6adbaa62b5ff of volume 97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] snapshot_file for this snap is: volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Created reservations ['6984bd4b-236b-4238-bd66-542587c53712', 'c2de5a94-ea96-4dc3-ae7d-127c0ed37140', '6e79bf83-db90-4646-a68e-d1ab7091dfa4', '14bcc213-919c-432f-8b94-85014fe704de'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa5af8-f84e-43cf-9e3b-965632fad63a]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff" returned: 0 in 0.557s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ba1444-7026-4031-b70e-56775c35a13c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:57:26 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e50ad7-62a9-4bfd-930b-9dca49744537]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c" returned: 0 in 0.469s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:27 devstack quobyte-client[82625]: System call of process 98460 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:27 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Delete snapshot completed successfully. Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-797abdb3-7954-4b5c-9930-926aacf8fb1e tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-d5a1605f-6458-4139-bd32-6f53ebac966b-delete_snapshot" released by "delete_snapshot" :: held 4.574s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-2da26344-f0ed-49c9-a8a7-17d5ada279e4-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff" returned: 0 in 0.411s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c.0485e34c-d703-46f4-b1a7-6adbaa62b5ff" returned: 0 in 0.155s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-2da26344-f0ed-49c9-a8a7-17d5ada279e4-delete_volume" acquired by "delete_volume" :: waited 0.237s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-0485e34c-d703-46f4-b1a7-6adbaa62b5ff" released by "_delete_snapshot" :: held 2.243s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.357s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:57:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-97ba1444-7026-4031-b70e-56775c35a13c" released by "delete_snapshot" :: held 2.384s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:28 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" acquired by "delete_volume" :: waited 0.026s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:28 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0aa961-b902-4bc8-ba7f-e42416726c24]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4" returned: 0 in 0.554s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2da26344-f0ed-49c9-a8a7-17d5ada279e4" returned: 0 in 0.189s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-quobyte-2da26344-f0ed-49c9-a8a7-17d5ada279e4" released by "delete_volume" :: held 0.881s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Created reservations ['606eee76-a19a-43c6-bb5f-3fbb75b82972', '68aead38-b100-4188-a773-fbb1171f0c30', 'dd3da520-87a3-49e0-b36a-ac90dc8ee1c4', 'df145c89-5993-4823-ad29-97c792f461e8'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Created reservations ['dfa40c44-c02d-4d31-a836-50f1b5a6497e', '5a7251b6-ec6d-4d91-af3a-8ad5116b95f3', '47d8d454-5517-49f0-8b94-02be8aa99a13', 'ed1945fd-f6d2-415c-aee6-fa8505f5a99e'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:57:29 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Delete snapshot completed successfully. Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-fdb3c58e-930a-4c03-972e-7457efcee273 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-0485e34c-d703-46f4-b1a7-6adbaa62b5ff-delete_snapshot" released by "delete_snapshot" :: held 4.319s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.143s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:30 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:57:30 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Deleted volume successfully. Sep 10 17:57:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-752bbbdf-998f-4631-9b3c-a973dd000349 tempest-VolumesSnapshotListTestJSON-211860661 None] Lock "cinder-2da26344-f0ed-49c9-a8a7-17d5ada279e4-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-97ba1444-7026-4031-b70e-56775c35a13c-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-97ba1444-7026-4031-b70e-56775c35a13c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:31 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-quobyte-97ba1444-7026-4031-b70e-56775c35a13c" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-97ba1444-7026-4031-b70e-56775c35a13c" acquired by "delete_volume" :: waited 0.028s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:31 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea423a75-6138-49b1-a9eb-cd127e1a639f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c" returned: 0 in 0.495s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-97ba1444-7026-4031-b70e-56775c35a13c" returned: 0 in 0.111s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-97ba1444-7026-4031-b70e-56775c35a13c" released by "delete_volume" :: held 0.847s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:32 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Created reservations ['b3b6ff6a-7138-41c7-bbad-d58e7ff98a1c', 'a73306a1-3a1f-4cb5-a8bc-4151ff753a02', '917b9ec5-b794-4def-be3e-92faa03d7a29', '0297b22e-a653-471d-95fa-989c0450e38a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:57:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.166s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:33 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:57:33 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Deleted volume successfully. Sep 10 17:57:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6da249e8-d98e-47bf-aacf-0b9cd8a57da9 tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-97ba1444-7026-4031-b70e-56775c35a13c-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "cinder-quobyte-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" acquired by "delete_volume" :: waited 0.018s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:34 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1085d383-b6d4-49d7-a394-cc6c64f2862e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:34 devstack quobyte-client[82625]: System call of process 98476 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" returned: 0 in 0.399s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" returned: 0 in 0.089s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-quobyte-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b" released by "delete_volume" :: held 0.656s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:35 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Created reservations ['7971ae9e-d7ae-4da9-b506-ad883ac1f5e5', '6ea29038-9ba9-4ab3-b530-78857cc38226', 'cf119660-7730-48b9-b9b4-b9b207c1ece6', '8e37ac10-25f0-496b-857e-bc8b891e2ab9'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:57:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.090s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:36 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:57:36 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Deleted volume successfully. Sep 10 17:57:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6832c0e9-6f51-42af-a013-8b4cf3b8b2ce tempest-SnapshotDependencyTests-1326249707 None] Lock "cinder-2ef3dd3e-cdff-4f84-8806-b4b14bd6ff7b-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:57:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Flow 'volume_create_manager' (dbb957cf-32b7-42b4-b72e-a31d5532a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322bde22-4795-415a-869d-d8b8b60fbf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322bde22-4795-415a-869d-d8b8b60fbf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1632108146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b95223a-b628-4291-9563-0680a9cc26d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f77e5a2cea384c4581bd613c8be8ff1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:39Z,use_quota=True,user_id='630fc93706dd4e2385be71b38e259351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a534935d-d431-48cf-906d-b8d09d88c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a534935d-d431-48cf-906d-b8d09d88c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44b8eb9-ed61-4827-a38d-49bcd5344dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44b8eb9-ed61-4827-a38d-49bcd5344dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b95223a-b628-4291-9563-0680a9cc26d9', 'volume_name': 'volume-4b95223a-b628-4291-9563-0680a9cc26d9', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8beb66-d629-41fa-a817-ade0e48ce5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8beb66-d629-41fa-a817-ade0e48ce5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8604f89-0c76-4555-a2d0-1d541c2f64f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:40 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Volume 4b95223a-b628-4291-9563-0680a9cc26d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b95223a-b628-4291-9563-0680a9cc26d9', 'volume_size': 1} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1632108146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b95223a-b628-4291-9563-0680a9cc26d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f77e5a2cea384c4581bd613c8be8ff1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:39Z,use_quota=True,user_id='630fc93706dd4e2385be71b38e259351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Creating volume 4b95223a-b628-4291-9563-0680a9cc26d9 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:57:40 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4b95223a-b628-4291-9563-0680a9cc26d9 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:40 devstack quobyte-client[82625]: System call of process 98481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:40 devstack quobyte-client[82625]: System call of process 98481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:40 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=116, name=volume-4b95223a-b628-4291-9563-0680a9cc26d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4b95223a-b628-4291-9563-0680a9cc26d9 1073741824" returned: 0 in 0.352s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4b95223a-b628-4291-9563-0680a9cc26d9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4b95223a-b628-4291-9563-0680a9cc26d9" returned: 0 in 0.094s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] <== create_volume: return (520ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:57:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.534s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8604f89-0c76-4555-a2d0-1d541c2f64f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b95223a-b628-4291-9563-0680a9cc26d9', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee224d88-ed41-42fb-8981-1a55db841770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:42 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Volume volume-4b95223a-b628-4291-9563-0680a9cc26d9 (4b95223a-b628-4291-9563-0680a9cc26d9): created successfully Sep 10 17:57:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee224d88-ed41-42fb-8981-1a55db841770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Flow 'volume_create_manager' (dbb957cf-32b7-42b4-b72e-a31d5532a43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:42 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5b2a74a6-6891-4be3-895b-8195b81eba34 tempest-VolumesListTestJSON-292625668 None] Created volume successfully. Sep 10 17:57:47 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Flow 'volume_create_manager' (3419dc75-81dd-486c-9742-9cc538aec6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145cfa54-d464-4463-a173-f18d57bf5b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145cfa54-d464-4463-a173-f18d57bf5b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1568216677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c9566e-1f38-4922-a6a3-87c8d56f64fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f77e5a2cea384c4581bd613c8be8ff1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:46Z,use_quota=True,user_id='630fc93706dd4e2385be71b38e259351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db49f855-b014-4f7a-9a68-a0704e0083cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db49f855-b014-4f7a-9a68-a0704e0083cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47880581-607a-4ea9-968e-5b0a621ddd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47880581-607a-4ea9-968e-5b0a621ddd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c9566e-1f38-4922-a6a3-87c8d56f64fb', 'volume_name': 'volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493af822-eb35-41eb-96ca-b422a1df4e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493af822-eb35-41eb-96ca-b422a1df4e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c5ca54-ccc1-4624-8db0-2517793ebcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:47 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Volume 42c9566e-1f38-4922-a6a3-87c8d56f64fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb', 'volume_size': 1} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1568216677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c9566e-1f38-4922-a6a3-87c8d56f64fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f77e5a2cea384c4581bd613c8be8ff1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:46Z,use_quota=True,user_id='630fc93706dd4e2385be71b38e259351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Creating volume 42c9566e-1f38-4922-a6a3-87c8d56f64fb {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:57:47 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:57:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:48 devstack quobyte-client[82625]: System call of process 98491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:48 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=117, name=volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb 1073741824" returned: 0 in 0.567s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb" returned: 0 in 0.278s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] <== create_volume: return (902ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:57:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:48 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:48 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Flow 'volume_create_manager' (84077a08-c8bd-423c-ac9a-64f57c4d0100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc08178-a016-46fd-a28a-23032bc16f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c5ca54-ccc1-4624-8db0-2517793ebcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20281cc9-bca5-4611-b371-02d0a57a2700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc08178-a016-46fd-a28a-23032bc16f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-301290857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dd7d62-61ee-47d5-b14c-468125ae2baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1132dadec034c1c897ec5489020facc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:48Z,use_quota=True,user_id='3ebf97d9a18a4067bd0fcd033171fdc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3476d18-c8ef-45e6-b986-96b2cb1de2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3476d18-c8ef-45e6-b986-96b2cb1de2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b543a-4a18-4a48-a844-d79f577fa4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b543a-4a18-4a48-a844-d79f577fa4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2dd7d62-61ee-47d5-b14c-468125ae2baa', 'volume_name': 'volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa', 'volume_size': 2}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d2999b-5302-4ff4-af2b-f0efc8dddb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d2999b-5302-4ff4-af2b-f0efc8dddb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e8919b-0d24-4e16-9f3a-a65734daee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:49 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Volume e2dd7d62-61ee-47d5-b14c-468125ae2baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa', 'volume_size': 2} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-301290857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dd7d62-61ee-47d5-b14c-468125ae2baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1132dadec034c1c897ec5489020facc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:48Z,use_quota=True,user_id='3ebf97d9a18a4067bd0fcd033171fdc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Creating volume e2dd7d62-61ee-47d5-b14c-468125ae2baa {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:57:49 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa 2147483648 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:49 devstack quobyte-client[82625]: System call of process 98495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:49 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=118, name=volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:49 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Volume volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb (42c9566e-1f38-4922-a6a3-87c8d56f64fb): created successfully Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20281cc9-bca5-4611-b371-02d0a57a2700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Flow 'volume_create_manager' (3419dc75-81dd-486c-9742-9cc538aec6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa 2147483648" returned: 0 in 0.613s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa" returned: 0 in 0.088s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] <== create_volume: return (751ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:57:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e8919b-0d24-4e16-9f3a-a65734daee41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa', 'volume_size': 2}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:50 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19a084d-e78b-4bf1-803c-f7a5cf6123c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-a9e41f00-d369-4c10-a8ab-edd0eff71ded tempest-VolumesListTestJSON-292625668 None] Created volume successfully. Sep 10 17:57:51 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Volume volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa (e2dd7d62-61ee-47d5-b14c-468125ae2baa): created successfully Sep 10 17:57:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19a084d-e78b-4bf1-803c-f7a5cf6123c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Flow 'volume_create_manager' (84077a08-c8bd-423c-ac9a-64f57c4d0100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:51 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ca058509-48ce-458a-ad99-81472db783a8 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Created volume successfully. Sep 10 17:57:52 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Flow 'volume_create_manager' (9df6ab74-da64-4da3-b103-fd749308239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7803ede1-38f3-4a05-b647-cfbac26776d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7803ede1-38f3-4a05-b647-cfbac26776d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1282273926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f77e5a2cea384c4581bd613c8be8ff1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:52Z,use_quota=True,user_id='630fc93706dd4e2385be71b38e259351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2853448-1580-4f82-b038-5aca1b9504a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2853448-1580-4f82-b038-5aca1b9504a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e52a42-21b9-4b8c-b197-ba9d45509ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e52a42-21b9-4b8c-b197-ba9d45509ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e', 'volume_name': 'volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537681be-aa6c-4dfc-af5f-b3605d57a157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537681be-aa6c-4dfc-af5f-b3605d57a157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f10a37f-3b3f-49eb-9854-d7058a1164e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:52 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Volume 51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e', 'volume_size': 1} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1282273926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f77e5a2cea384c4581bd613c8be8ff1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:57:52Z,use_quota=True,user_id='630fc93706dd4e2385be71b38e259351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Creating volume 51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:57:52 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:57:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:52 devstack quobyte-client[82625]: System call of process 98516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:57:52 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=119, name=volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e 1073741824" returned: 0 in 0.512s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e" returned: 0 in 0.111s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] <== create_volume: return (716ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:57:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f10a37f-3b3f-49eb-9854-d7058a1164e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbb24b0-dc97-48f2-8487-165c7b4963b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:57:54 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Volume volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e (51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e): created successfully Sep 10 17:57:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbb24b0-dc97-48f2-8487-165c7b4963b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:57:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Flow 'volume_create_manager' (9df6ab74-da64-4da3-b103-fd749308239e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:57:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b1fcac17-6d69-41c1-ae4f-231f1896a70f tempest-VolumesListTestJSON-292625668 None] Created volume successfully. Sep 10 17:57:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:57:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:57:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Creating offline snapshot 00af9692-f26f-4672-8bbb-4dc57697f93f of volume e2dd7d62-61ee-47d5-b14c-468125ae2baa {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 17:57:55 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27d57b5-2a1c-46ac-b887-7d7df5c24e7e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa" returned: 0 in 0.640s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f 2G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:55 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=120, name=volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f 2G" returned: 0 in 0.267s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "qemu-img rebase -u -b volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f" returned: 0 in 0.251s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f" returned: 0 in 0.106s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f" returned: 0 in 0.237s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.info" returned: 0 in 0.146s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:56 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 17:57:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:57:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.info" returned: 0 in 0.148s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:57:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:57:57 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:DELETE=10,cinder:SELECT=55,cinder:UPDATE=69,cinder:INSERT=18 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:57:57 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=76,cinder:SELECT=51,cinder:INSERT=14,cinder:DELETE=5 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:57:57 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4f1687e3-640b-4b2c-ba0d-141eaa854e06 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Create snapshot completed successfully Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "cinder-00af9692-f26f-4672-8bbb-4dc57697f93f-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-00af9692-f26f-4672-8bbb-4dc57697f93f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.202s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:59 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "cinder-quobyte-e2dd7d62-61ee-47d5-b14c-468125ae2baa" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-quobyte-e2dd7d62-61ee-47d5-b14c-468125ae2baa" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "cinder-quobyte-00af9692-f26f-4672-8bbb-4dc57697f93f" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-quobyte-00af9692-f26f-4672-8bbb-4dc57697f93f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Deleting offline snapshot 00af9692-f26f-4672-8bbb-4dc57697f93f of volume e2dd7d62-61ee-47d5-b14c-468125ae2baa {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] snapshot_file for this snap is: volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dd01ef-2d88-447d-9a15-bd223e57e4bb]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:57:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:00 devstack quobyte-client[82625]: System call of process 98550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f" returned: 0 in 1.056s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 17:58:00 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2bbe6-b48b-43b3-bdd8-39700ae1e00f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa" returned: 0 in 0.436s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:01 devstack quobyte-client[82625]: System call of process 98557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Acquiring lock "cinder-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Lock "cinder-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f" returned: 0 in 0.510s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa.00af9692-f26f-4672-8bbb-4dc57697f93f" returned: 0 in 0.264s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-quobyte-00af9692-f26f-4672-8bbb-4dc57697f93f" released by "_delete_snapshot" :: held 2.959s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:02 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Acquiring lock "cinder-quobyte-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-quobyte-e2dd7d62-61ee-47d5-b14c-468125ae2baa" released by "delete_snapshot" :: held 3.155s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Lock "cinder-quobyte-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e" acquired by "delete_volume" :: waited 0.085s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:02 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2843a301-ae03-4b99-83e0-fbb60eeb3111]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:03 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Created reservations ['1f46a386-2481-4b11-9273-ba25533991a1', 'bfd4f55c-04e2-4fc3-b4be-c5173498a2da', 'ae6bae7a-c414-44b3-8714-fcddc6ca65f5', 'c4fd1c44-77a7-4b3c-8e85-660d905b366c'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:03 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Delete snapshot completed successfully. Sep 10 17:58:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e5937af3-d8b5-480a-875c-566890aa1b10 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-00af9692-f26f-4672-8bbb-4dc57697f93f-delete_snapshot" released by "delete_snapshot" :: held 4.091s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e" returned: 0 in 0.870s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e" returned: 0 in 0.085s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Lock "cinder-quobyte-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e" released by "delete_volume" :: held 1.127s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Created reservations ['234072a9-8b15-49d0-903f-4ce7d8941c1e', '21f003ba-3831-4061-98ff-24e4b0efee3c', '98735d79-c81b-4ba7-acc3-7b1bd73a358c', '76e916ec-841d-443c-9131-acc9e69cb537'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.118s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Deleted volume successfully. Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "cinder-e2dd7d62-61ee-47d5-b14c-468125ae2baa-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f3b7fc0b-07d1-49b7-9a2a-829eed73a23e tempest-VolumesListTestJSON-292625668 None] Lock "cinder-51aa1fff-fa62-4d02-ab6e-7e5e3c96a73e-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-e2dd7d62-61ee-47d5-b14c-468125ae2baa-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "cinder-quobyte-e2dd7d62-61ee-47d5-b14c-468125ae2baa" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-quobyte-e2dd7d62-61ee-47d5-b14c-468125ae2baa" acquired by "delete_volume" :: waited 0.015s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:05 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf775ca-8276-4cc9-ad3a-285d66e4a937]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Acquiring lock "cinder-42c9566e-1f38-4922-a6a3-87c8d56f64fb-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Lock "cinder-42c9566e-1f38-4922-a6a3-87c8d56f64fb-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:05 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:05 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Acquiring lock "cinder-quobyte-42c9566e-1f38-4922-a6a3-87c8d56f64fb" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa" returned: 0 in 0.867s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Lock "cinder-quobyte-42c9566e-1f38-4922-a6a3-87c8d56f64fb" acquired by "delete_volume" :: waited 0.186s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:06 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ab7fd6-2be4-4055-b30a-b420156a0023]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-e2dd7d62-61ee-47d5-b14c-468125ae2baa" returned: 0 in 0.387s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-quobyte-e2dd7d62-61ee-47d5-b14c-468125ae2baa" released by "delete_volume" :: held 1.498s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:06 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Created reservations ['494f046e-6562-4080-9f97-69c59dcb0075', '1a94fa1b-363a-4ae7-b278-8b927fc7ee92', '0c5bf2a2-fd39-4c4a-a1c7-1dd087d75f67', '7cfc4d4d-a2e6-43b6-aead-6998eeae6875'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb" returned: 0 in 0.698s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-42c9566e-1f38-4922-a6a3-87c8d56f64fb" returned: 0 in 0.121s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Lock "cinder-quobyte-42c9566e-1f38-4922-a6a3-87c8d56f64fb" released by "delete_volume" :: held 1.081s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:07 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Created reservations ['bf8bc5a2-dbe4-4be7-b82e-9b9ac0243e83', '0bf61751-e699-437b-8509-dfaace2ba46a', '07e941c4-3380-4cb0-9a18-b69a24eaaea2', 'b98f2115-e1cb-44df-81e1-7ee516315e3f'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:08 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.147s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:09 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:09 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Deleted volume successfully. Sep 10 17:58:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0fc41217-1728-4ac2-93dd-acc63112ab91 tempest-VolumesSnapshotNegativeTestJSON-1262954984 None] Lock "cinder-e2dd7d62-61ee-47d5-b14c-468125ae2baa-delete_volume" released by "delete_volume" :: held 5.281s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Acquiring lock "cinder-4b95223a-b628-4291-9563-0680a9cc26d9-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.370s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:10 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Deleted volume successfully. Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Lock "cinder-4b95223a-b628-4291-9563-0680a9cc26d9-delete_volume" acquired by "delete_volume" :: waited 0.178s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9bd52a4a-f3a4-4493-9d33-d00b066de547 tempest-VolumesListTestJSON-292625668 None] Lock "cinder-42c9566e-1f38-4922-a6a3-87c8d56f64fb-delete_volume" released by "delete_volume" :: held 4.944s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:10 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Acquiring lock "cinder-quobyte-4b95223a-b628-4291-9563-0680a9cc26d9" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Lock "cinder-quobyte-4b95223a-b628-4291-9563-0680a9cc26d9" acquired by "delete_volume" :: waited 0.032s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ae6bf1-e3a7-4e90-82f8-42a69f77f38a]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4b95223a-b628-4291-9563-0680a9cc26d9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4b95223a-b628-4291-9563-0680a9cc26d9" returned: 0 in 0.580s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4b95223a-b628-4291-9563-0680a9cc26d9 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4b95223a-b628-4291-9563-0680a9cc26d9" returned: 0 in 0.156s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Lock "cinder-quobyte-4b95223a-b628-4291-9563-0680a9cc26d9" released by "delete_volume" :: held 0.959s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:11 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Created reservations ['878adbf4-50d4-4fd3-935c-e4e9f4c9d8a6', 'f89ab7bb-bb5e-45b1-9e9f-96183bb2397e', '20294d49-6d0d-41e3-8e8c-47c11a2f4453', '30189d12-5498-467c-95a7-fe42a72a05ff'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.141s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:12 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Deleted volume successfully. Sep 10 17:58:12 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b39b5acb-bfec-4069-8041-db68160a5dae tempest-VolumesListTestJSON-292625668 None] Lock "cinder-4b95223a-b628-4291-9563-0680a9cc26d9-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:15 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (b1f3da75-17b4-48af-8f64-de7dc131d59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1558d96-0afe-4867-adda-6d021be96ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1558d96-0afe-4867-adda-6d021be96ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-994467374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4fce01-afef-4695-9501-82b5fd8d51dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:15Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe72a9e2-1881-47b9-9086-ce0da26a7a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe72a9e2-1881-47b9-9086-ce0da26a7a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9389cad1-9362-45cc-86b2-a4e946d67f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9389cad1-9362-45cc-86b2-a4e946d67f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4fce01-afef-4695-9501-82b5fd8d51dd', 'volume_name': 'volume-4d4fce01-afef-4695-9501-82b5fd8d51dd', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece8862a-17cb-4b06-9232-8f0ff69f8f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece8862a-17cb-4b06-9232-8f0ff69f8f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b879ee8-d3e3-44ca-ad46-6a9bc4fffd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:15 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Volume 4d4fce01-afef-4695-9501-82b5fd8d51dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4fce01-afef-4695-9501-82b5fd8d51dd', 'volume_size': 1} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-994467374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4fce01-afef-4695-9501-82b5fd8d51dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:15Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Creating volume 4d4fce01-afef-4695-9501-82b5fd8d51dd {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:15 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4fce01-afef-4695-9501-82b5fd8d51dd 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:15 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=122, name=volume-4d4fce01-afef-4695-9501-82b5fd8d51dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4fce01-afef-4695-9501-82b5fd8d51dd 1073741824" returned: 0 in 0.628s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4fce01-afef-4695-9501-82b5fd8d51dd {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:16 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:16 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (9bcb8ce3-5f23-432d-a56f-08097742b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afee69c-b02f-48d1-bdc3-bded2d044e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4fce01-afef-4695-9501-82b5fd8d51dd" returned: 0 in 0.781s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] <== create_volume: return (1441ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afee69c-b02f-48d1-bdc3-bded2d044e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277119164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b1d6ef-11f0-4425-b439-4d950f65bd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:16Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fd4363-c9b2-4239-8d93-018722fe27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fd4363-c9b2-4239-8d93-018722fe27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5e0fd5-2b4f-41f0-a4b1-44980ce539b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5e0fd5-2b4f-41f0-a4b1-44980ce539b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b1d6ef-11f0-4425-b439-4d950f65bd14', 'volume_name': 'volume-24b1d6ef-11f0-4425-b439-4d950f65bd14', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318d3357-f454-4a52-951d-761d87b5ff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318d3357-f454-4a52-951d-761d87b5ff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d89ba3c-79a5-41c5-bdc2-33ccb3cba7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:17 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Volume 24b1d6ef-11f0-4425-b439-4d950f65bd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b1d6ef-11f0-4425-b439-4d950f65bd14', 'volume_size': 1} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277119164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b1d6ef-11f0-4425-b439-4d950f65bd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:16Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Creating volume 24b1d6ef-11f0-4425-b439-4d950f65bd14 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:17 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-24b1d6ef-11f0-4425-b439-4d950f65bd14 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:17 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:17 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=123, name=volume-24b1d6ef-11f0-4425-b439-4d950f65bd14, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (1b6bf117-9871-4cc3-9593-c7e437584dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b83cc61-ff12-418b-aba4-2fdd38318506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b83cc61-ff12-418b-aba4-2fdd38318506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-415318116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84871ed5-440f-4a8f-a059-53597e3b0936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:16Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed75d90-2037-4a66-a658-208831b47627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed75d90-2037-4a66-a658-208831b47627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcacf8a-962b-4a4a-b436-301423f553cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcacf8a-962b-4a4a-b436-301423f553cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84871ed5-440f-4a8f-a059-53597e3b0936', 'volume_name': 'volume-84871ed5-440f-4a8f-a059-53597e3b0936', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45055d3a-e1a9-46df-b67a-216d20983573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45055d3a-e1a9-46df-b67a-216d20983573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42edd5a9-3919-445b-aafa-6a4cb0d9865b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:18 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Volume 84871ed5-440f-4a8f-a059-53597e3b0936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84871ed5-440f-4a8f-a059-53597e3b0936', 'volume_size': 1} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b879ee8-d3e3-44ca-ad46-6a9bc4fffd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4fce01-afef-4695-9501-82b5fd8d51dd', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfd35fc-3ccd-4e8e-a1c0-74408c170a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-24b1d6ef-11f0-4425-b439-4d950f65bd14 1073741824" returned: 0 in 0.898s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-24b1d6ef-11f0-4425-b439-4d950f65bd14 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:18 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Volume volume-4d4fce01-afef-4695-9501-82b5fd8d51dd (4d4fce01-afef-4695-9501-82b5fd8d51dd): created successfully Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfd35fc-3ccd-4e8e-a1c0-74408c170a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (b1f3da75-17b4-48af-8f64-de7dc131d59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (35e493f0-93c7-4849-8d5b-8e31a7fca3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbaa687e-085f-4e9a-b39d-4889b4f666dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-24b1d6ef-11f0-4425-b439-4d950f65bd14" returned: 0 in 1.025s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6572e326-d6b2-4116-be3b-119dff0fd4a9 tempest-CreateVolumesFromImageTest-1091316 None] Created volume successfully. Sep 10 17:58:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (09a44e1a-56bf-454d-913e-d7c3016a3070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480fa742-0b4e-4b92-8635-c230fe16917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] <== create_volume: return (2015ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480fa742-0b4e-4b92-8635-c230fe16917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-908883454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec000056-a679-43ce-8835-2f9de7010d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:17Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03576cb0-f7a7-4147-b230-f0ef79e9f275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03576cb0-f7a7-4147-b230-f0ef79e9f275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdc2dff-9cb1-430e-833c-b858e1d227a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdc2dff-9cb1-430e-833c-b858e1d227a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec000056-a679-43ce-8835-2f9de7010d98', 'volume_name': 'volume-ec000056-a679-43ce-8835-2f9de7010d98', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ddb820-b668-4879-9a03-f3e6f9ee20e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ddb820-b668-4879-9a03-f3e6f9ee20e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafad694-59ce-4db6-abbf-4d1fa7234bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:19 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Volume ec000056-a679-43ce-8835-2f9de7010d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec000056-a679-43ce-8835-2f9de7010d98', 'volume_size': 1} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-908883454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec000056-a679-43ce-8835-2f9de7010d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:17Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Creating volume ec000056-a679-43ce-8835-2f9de7010d98 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:19 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec000056-a679-43ce-8835-2f9de7010d98 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:19 devstack quobyte-client[82625]: System call of process 98599 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:19 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=124, name=volume-ec000056-a679-43ce-8835-2f9de7010d98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbaa687e-085f-4e9a-b39d-4889b4f666dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824713338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b62f5e-4a88-4572-a1fd-ef769db19c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:18Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3c4eeb-1dcb-46d6-bd6b-36f30fa02879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3c4eeb-1dcb-46d6-bd6b-36f30fa02879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3adea39-1fa9-4905-850c-581619ccbf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3adea39-1fa9-4905-850c-581619ccbf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b62f5e-4a88-4572-a1fd-ef769db19c9b', 'volume_name': 'volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685b34e5-f6f7-46d4-853a-3dc4a3c3f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685b34e5-f6f7-46d4-853a-3dc4a3c3f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc38aaee-5019-48b0-abc2-0f165dd919ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:20 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Volume 60b62f5e-4a88-4572-a1fd-ef769db19c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b', 'volume_size': 1} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d89ba3c-79a5-41c5-bdc2-33ccb3cba7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b1d6ef-11f0-4425-b439-4d950f65bd14', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65def87f-9d7b-4a59-9bb7-e2ddf5c158a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec000056-a679-43ce-8835-2f9de7010d98 1073741824" returned: 0 in 0.969s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec000056-a679-43ce-8835-2f9de7010d98 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:20 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Volume volume-24b1d6ef-11f0-4425-b439-4d950f65bd14 (24b1d6ef-11f0-4425-b439-4d950f65bd14): created successfully Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65def87f-9d7b-4a59-9bb7-e2ddf5c158a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (9bcb8ce3-5f23-432d-a56f-08097742b511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:20 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-bc5b034a-81c9-4b66-9060-39b2ccb5d564 tempest-CreateVolumesFromImageTest-1091316 None] Created volume successfully. Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec000056-a679-43ce-8835-2f9de7010d98" returned: 0 in 0.448s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] <== create_volume: return (1439ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-415318116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84871ed5-440f-4a8f-a059-53597e3b0936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:16Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Creating volume 84871ed5-440f-4a8f-a059-53597e3b0936 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:20 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-84871ed5-440f-4a8f-a059-53597e3b0936 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:20 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=125, name=volume-84871ed5-440f-4a8f-a059-53597e3b0936, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafad694-59ce-4db6-abbf-4d1fa7234bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec000056-a679-43ce-8835-2f9de7010d98', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f623b8b2-a1aa-4b00-b519-f99f4d6c8cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-84871ed5-440f-4a8f-a059-53597e3b0936 1073741824" returned: 0 in 0.610s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-84871ed5-440f-4a8f-a059-53597e3b0936 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-84871ed5-440f-4a8f-a059-53597e3b0936" returned: 0 in 0.222s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] <== create_volume: return (918ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824713338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b62f5e-4a88-4572-a1fd-ef769db19c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ccbe5665924100a5df6c4087391be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:18Z,use_quota=True,user_id='152c3feead5b4a10b3e557b5705da8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Creating volume 60b62f5e-4a88-4572-a1fd-ef769db19c9b {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:21 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:22 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=126, name=volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:22 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Volume volume-ec000056-a679-43ce-8835-2f9de7010d98 (ec000056-a679-43ce-8835-2f9de7010d98): created successfully Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f623b8b2-a1aa-4b00-b519-f99f4d6c8cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (09a44e1a-56bf-454d-913e-d7c3016a3070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b 1073741824" returned: 0 in 0.597s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ed759f72-cc18-42b1-b69f-0bffc10bd9b5 tempest-CreateVolumesFromImageTest-1091316 None] Created volume successfully. Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42edd5a9-3919-445b-aafa-6a4cb0d9865b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84871ed5-440f-4a8f-a059-53597e3b0936', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99255409-2dff-4bd3-a05d-be3f6f3dac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b" returned: 0 in 0.479s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] <== create_volume: return (1112ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:22 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Volume volume-84871ed5-440f-4a8f-a059-53597e3b0936 (84871ed5-440f-4a8f-a059-53597e3b0936): created successfully Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99255409-2dff-4bd3-a05d-be3f6f3dac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (1b6bf117-9871-4cc3-9593-c7e437584dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc38aaee-5019-48b0-abc2-0f165dd919ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3738fd8-3eb2-47cd-b30b-5b1f5598571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:23 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-40db9f9c-8377-4333-b2d4-be46b36cd114 tempest-CreateVolumesFromImageTest-1091316 None] Created volume successfully. Sep 10 17:58:23 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Volume volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b (60b62f5e-4a88-4572-a1fd-ef769db19c9b): created successfully Sep 10 17:58:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3738fd8-3eb2-47cd-b30b-5b1f5598571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Flow 'volume_create_manager' (35e493f0-93c7-4849-8d5b-8e31a7fca3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:23 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2cc66edc-d145-45f5-8abe-d23adf2584ff tempest-CreateVolumesFromImageTest-1091316 None] Created volume successfully. Sep 10 17:58:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-60b62f5e-4a88-4572-a1fd-ef769db19c9b-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-60b62f5e-4a88-4572-a1fd-ef769db19c9b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-quobyte-60b62f5e-4a88-4572-a1fd-ef769db19c9b" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-60b62f5e-4a88-4572-a1fd-ef769db19c9b" acquired by "delete_volume" :: waited 0.026s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:24 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[151ce5e5-e3dd-4829-817e-cbd2ab2fd209]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b" returned: 0 in 0.554s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-60b62f5e-4a88-4572-a1fd-ef769db19c9b" returned: 0 in 0.137s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-60b62f5e-4a88-4572-a1fd-ef769db19c9b" released by "delete_volume" :: held 0.921s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Created reservations ['5d0e388c-9091-4161-bbcb-37f90b6dd2d7', '215e323c-d02b-44aa-9629-d14ff5e488ba', 'd3dd1ca1-2ebd-41f0-a490-32342835336a', '448418af-1a91-4b11-bf61-4bbe5d162e04'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.100s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Deleted volume successfully. Sep 10 17:58:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-07e8291e-ee0e-4f6b-9acb-1d1640bd76d4 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-60b62f5e-4a88-4572-a1fd-ef769db19c9b-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-ec000056-a679-43ce-8835-2f9de7010d98-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-ec000056-a679-43ce-8835-2f9de7010d98-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:26 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-quobyte-ec000056-a679-43ce-8835-2f9de7010d98" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-ec000056-a679-43ce-8835-2f9de7010d98" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dae8a8f-2e82-4a64-a6ed-8972ed651243]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec000056-a679-43ce-8835-2f9de7010d98 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec000056-a679-43ce-8835-2f9de7010d98" returned: 0 in 0.480s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec000056-a679-43ce-8835-2f9de7010d98 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-ec000056-a679-43ce-8835-2f9de7010d98" returned: 0 in 0.359s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-ec000056-a679-43ce-8835-2f9de7010d98" released by "delete_volume" :: held 1.095s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.524s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Created reservations ['2a480400-d05b-4b59-8035-144ad85c3f27', '777055ac-8358-43f7-8ac2-468e0f4b1173', 'd25043a3-07c1-4465-9ba7-aef123d1e6e4', '7b8e93ea-45ad-4205-bdb7-f6d0432eb92c'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.113s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Deleted volume successfully. Sep 10 17:58:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-84871ed5-440f-4a8f-a059-53597e3b0936-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-3e3ff089-9bbc-4f28-b1f7-aaf1f73d18bc tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-ec000056-a679-43ce-8835-2f9de7010d98-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-84871ed5-440f-4a8f-a059-53597e3b0936-delete_volume" acquired by "delete_volume" :: waited 0.217s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:29 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-quobyte-84871ed5-440f-4a8f-a059-53597e3b0936" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-84871ed5-440f-4a8f-a059-53597e3b0936" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:29 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb3f144-7bef-4418-8ffe-7d8b8a1f58d8]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-84871ed5-440f-4a8f-a059-53597e3b0936 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-84871ed5-440f-4a8f-a059-53597e3b0936" returned: 0 in 0.480s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-84871ed5-440f-4a8f-a059-53597e3b0936 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-84871ed5-440f-4a8f-a059-53597e3b0936" returned: 0 in 0.107s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-84871ed5-440f-4a8f-a059-53597e3b0936" released by "delete_volume" :: held 0.787s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Created reservations ['5ab0f3d2-d5ad-4b7f-bca5-50afb18ddcfb', '324aa015-51d0-4f1c-898b-356ef270d2c5', 'd221525b-c924-4c02-b447-2705e464f989', '2cf2d22b-b7fd-4efc-acb2-9cfed44f1b91'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.124s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:30 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:31 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Deleted volume successfully. Sep 10 17:58:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-48884030-5c9d-4889-b77d-ab39a94dd2e8 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-84871ed5-440f-4a8f-a059-53597e3b0936-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-24b1d6ef-11f0-4425-b439-4d950f65bd14-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-24b1d6ef-11f0-4425-b439-4d950f65bd14-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:31 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-quobyte-24b1d6ef-11f0-4425-b439-4d950f65bd14" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-24b1d6ef-11f0-4425-b439-4d950f65bd14" acquired by "delete_volume" :: waited 0.019s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:31 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4250d9b-7e8c-41f7-ac10-e20a83a7c9ce]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-24b1d6ef-11f0-4425-b439-4d950f65bd14 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-24b1d6ef-11f0-4425-b439-4d950f65bd14" returned: 0 in 0.489s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-24b1d6ef-11f0-4425-b439-4d950f65bd14 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-24b1d6ef-11f0-4425-b439-4d950f65bd14" returned: 0 in 0.168s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-24b1d6ef-11f0-4425-b439-4d950f65bd14" released by "delete_volume" :: held 0.945s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Created reservations ['e7393079-d848-4b8e-a8ab-ba1e36f2e8bd', '35bb8eb3-6713-40fb-9860-9067a780a754', '019e5610-c1d7-4249-b16c-733a1b07e098', '06fe3caa-5815-482c-8f5b-7f07b7e50035'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.099s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:33 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Deleted volume successfully. Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-45118a12-e800-48e3-be4f-8db90e77757e tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-24b1d6ef-11f0-4425-b439-4d950f65bd14-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-4d4fce01-afef-4695-9501-82b5fd8d51dd-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-4d4fce01-afef-4695-9501-82b5fd8d51dd-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "cinder-quobyte-4d4fce01-afef-4695-9501-82b5fd8d51dd" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-4d4fce01-afef-4695-9501-82b5fd8d51dd" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:34 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[64417fca-effb-4289-a5b8-7c2cc0a31a15]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4fce01-afef-4695-9501-82b5fd8d51dd {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4fce01-afef-4695-9501-82b5fd8d51dd" returned: 0 in 0.464s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4fce01-afef-4695-9501-82b5fd8d51dd {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d4fce01-afef-4695-9501-82b5fd8d51dd" returned: 0 in 0.132s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-quobyte-4d4fce01-afef-4695-9501-82b5fd8d51dd" released by "delete_volume" :: held 0.793s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Created reservations ['066b7ef9-10da-412b-8407-ee01bbecf8cf', '92f7bbd8-ac4a-42f3-9626-40aeaed01639', '914dc712-6563-4ba8-bee4-5c72629b868c', '64aa55ec-7a3a-4983-acfb-cdaaa78a3242'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.104s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:35 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Deleted volume successfully. Sep 10 17:58:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-4a75b482-ee32-45ca-a581-b4c6ee018f74 tempest-CreateVolumesFromImageTest-1091316 None] Lock "cinder-4d4fce01-afef-4695-9501-82b5fd8d51dd-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:39 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (ab60404e-9061-403b-b01a-781c59fb6d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4548ff5f-798b-4673-aa3d-f6c713806152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4548ff5f-798b-4673-aa3d-f6c713806152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374529918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83eea769-ff24-445b-94fc-55d5921cc868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:40Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c4ef78-1152-4f9d-9b2b-40d1a004c58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c4ef78-1152-4f9d-9b2b-40d1a004c58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc1c4e1-8f0d-4ecb-b066-3df08e992ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc1c4e1-8f0d-4ecb-b066-3df08e992ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83eea769-ff24-445b-94fc-55d5921cc868', 'volume_name': 'volume-83eea769-ff24-445b-94fc-55d5921cc868', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c887f5e-7ab7-4db8-8a82-53e7167e7593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c887f5e-7ab7-4db8-8a82-53e7167e7593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85f472c-d85b-4034-a5a3-132d2aa88ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:39 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume 83eea769-ff24-445b-94fc-55d5921cc868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83eea769-ff24-445b-94fc-55d5921cc868', 'volume_size': 1} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374529918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83eea769-ff24-445b-94fc-55d5921cc868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:40Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Creating volume 83eea769-ff24-445b-94fc-55d5921cc868 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:39 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83eea769-ff24-445b-94fc-55d5921cc868 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:40 devstack quobyte-client[82625]: System call of process 98641 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:40 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=127, name=volume-83eea769-ff24-445b-94fc-55d5921cc868, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83eea769-ff24-445b-94fc-55d5921cc868 1073741824" returned: 0 in 0.409s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83eea769-ff24-445b-94fc-55d5921cc868 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83eea769-ff24-445b-94fc-55d5921cc868" returned: 0 in 0.119s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85f472c-d85b-4034-a5a3-132d2aa88ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83eea769-ff24-445b-94fc-55d5921cc868', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c370d71-2255-4dd6-b7b0-8805133f0d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:40 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume volume-83eea769-ff24-445b-94fc-55d5921cc868 (83eea769-ff24-445b-94fc-55d5921cc868): created successfully Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c370d71-2255-4dd6-b7b0-8805133f0d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (ab60404e-9061-403b-b01a-781c59fb6d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:40 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c2347318-f3bd-42bb-b281-d293c79f4cf6 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created volume successfully. Sep 10 17:58:42 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (3ea25ee9-6fb2-4205-8915-252a032b1e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bc41ef-1208-43fe-bd3b-dcbbb9924209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bc41ef-1208-43fe-bd3b-dcbbb9924209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297281794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26882ffe-3449-47b4-a043-b42eecbf0c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:42Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60f94d1-d86b-4bd7-a5e3-85f279b8faa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60f94d1-d86b-4bd7-a5e3-85f279b8faa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b8840a-61a5-41fa-83a2-3c95ed884281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b8840a-61a5-41fa-83a2-3c95ed884281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26882ffe-3449-47b4-a043-b42eecbf0c38', 'volume_name': 'volume-26882ffe-3449-47b4-a043-b42eecbf0c38', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d94571-e8e3-46d6-91df-c31fa6a21e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d94571-e8e3-46d6-91df-c31fa6a21e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c094c212-8431-4b2d-baaa-19ea96be7f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:42 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume 26882ffe-3449-47b4-a043-b42eecbf0c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26882ffe-3449-47b4-a043-b42eecbf0c38', 'volume_size': 1} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297281794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26882ffe-3449-47b4-a043-b42eecbf0c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:42Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Creating volume 26882ffe-3449-47b4-a043-b42eecbf0c38 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:42 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-26882ffe-3449-47b4-a043-b42eecbf0c38 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:42 devstack quobyte-client[82625]: System call of process 98645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:42 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=128, name=volume-26882ffe-3449-47b4-a043-b42eecbf0c38, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-26882ffe-3449-47b4-a043-b42eecbf0c38 1073741824" returned: 0 in 0.846s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-26882ffe-3449-47b4-a043-b42eecbf0c38 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:43 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:43 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:43 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (8081a125-8f38-442e-be58-81e0708fb82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:43 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78c96ab-5922-43c7-917f-4de856383c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78c96ab-5922-43c7-917f-4de856383c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013861566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d867ad4-9d93-44c3-aca7-4c6d2d5159ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:43Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388648f2-e7d7-47c2-9e58-80b4ca1de862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388648f2-e7d7-47c2-9e58-80b4ca1de862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf44171-41d2-4199-a26b-1f5df6ac859e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf44171-41d2-4199-a26b-1f5df6ac859e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d867ad4-9d93-44c3-aca7-4c6d2d5159ef', 'volume_name': 'volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd77f0f-7a38-4c54-b9fb-40b327f3dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd77f0f-7a38-4c54-b9fb-40b327f3dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4a80ee-b9a9-46d0-b739-67c0c8db9fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume 1d867ad4-9d93-44c3-aca7-4c6d2d5159ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef', 'volume_size': 1} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:44 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (947a9708-80e9-4a11-8839-dcf6f108e7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359065c1-e96c-4ccc-b9c2-162469ad807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-26882ffe-3449-47b4-a043-b42eecbf0c38" returned: 0 in 0.736s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] <== create_volume: return (1647ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013861566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d867ad4-9d93-44c3-aca7-4c6d2d5159ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:43Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Creating volume 1d867ad4-9d93-44c3-aca7-4c6d2d5159ef {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:44 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:44 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=129, name=volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c094c212-8431-4b2d-baaa-19ea96be7f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26882ffe-3449-47b4-a043-b42eecbf0c38', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4987e8-0c4e-41fb-bba0-3b0600f5a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359065c1-e96c-4ccc-b9c2-162469ad807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094972841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3660d396-879a-4bb6-ac74-f287aece726a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:43Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486dc744-3d87-4f76-b8bb-49495abef3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486dc744-3d87-4f76-b8bb-49495abef3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6b40b8-e886-4174-aafc-f37573100642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6b40b8-e886-4174-aafc-f37573100642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3660d396-879a-4bb6-ac74-f287aece726a', 'volume_name': 'volume-3660d396-879a-4bb6-ac74-f287aece726a', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b62bd4c-5cfe-48c9-b0d8-d45d1ede0e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b62bd4c-5cfe-48c9-b0d8-d45d1ede0e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11ccb23-a346-40dd-b80f-d9815d6717d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:44 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume 3660d396-879a-4bb6-ac74-f287aece726a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3660d396-879a-4bb6-ac74-f287aece726a', 'volume_size': 1} Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:44 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:44 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (16644594-d890-4fde-8715-0e8b7287b4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c21760-56c7-4494-8b77-6c4767f79953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume volume-26882ffe-3449-47b4-a043-b42eecbf0c38 (26882ffe-3449-47b4-a043-b42eecbf0c38): created successfully Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4987e8-0c4e-41fb-bba0-3b0600f5a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (3ea25ee9-6fb2-4205-8915-252a032b1e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (36bbfe4e-c1c9-4a42-962d-db2e3f372ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd52ff63-1c7b-429d-a2e0-79a0fc4c426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef 1073741824" returned: 0 in 0.850s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:45 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5293d89e-e0e6-4986-9d2b-fa004a9f888a tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created volume successfully. Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd52ff63-1c7b-429d-a2e0-79a0fc4c426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942504792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:44Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0be5f7-77b4-4152-a435-6e010c099c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0be5f7-77b4-4152-a435-6e010c099c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef67558-a0cd-430b-8f01-c648753ae21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef67558-a0cd-430b-8f01-c648753ae21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd', 'volume_name': 'volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279f654e-f7e7-4502-a7b9-b2aea1698043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279f654e-f7e7-4502-a7b9-b2aea1698043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800902d7-77a3-463e-bb2d-19f38e085dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume 4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd', 'volume_size': 1} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c21760-56c7-4494-8b77-6c4767f79953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1265076526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3110fd-731b-4550-9d1a-3323997c1602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:44Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9fb4f0-3924-4fa4-a6e1-9214bbdae004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9fb4f0-3924-4fa4-a6e1-9214bbdae004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140c77ad-29d1-4bc3-9625-b28cd75f9c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140c77ad-29d1-4bc3-9625-b28cd75f9c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3110fd-731b-4550-9d1a-3323997c1602', 'volume_name': 'volume-3a3110fd-731b-4550-9d1a-3323997c1602', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1321d09-60d1-42d1-b6aa-750f8150dd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1321d09-60d1-42d1-b6aa-750f8150dd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d0cda9-7709-40b6-baeb-1a8238e423ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:45 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume 3a3110fd-731b-4550-9d1a-3323997c1602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3110fd-731b-4550-9d1a-3323997c1602', 'volume_size': 1} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef" returned: 0 in 0.555s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] <== create_volume: return (1419ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094972841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3660d396-879a-4bb6-ac74-f287aece726a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:43Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Creating volume 3660d396-879a-4bb6-ac74-f287aece726a {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:45 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3660d396-879a-4bb6-ac74-f287aece726a 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:45 devstack quobyte-client[82625]: System call of process 98656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:45 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=130, name=volume-3660d396-879a-4bb6-ac74-f287aece726a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4a80ee-b9a9-46d0-b739-67c0c8db9fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cf5fdf-e632-4dcc-a5d6-d29726d0b907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:46 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef (1d867ad4-9d93-44c3-aca7-4c6d2d5159ef): created successfully Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cf5fdf-e632-4dcc-a5d6-d29726d0b907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (8081a125-8f38-442e-be58-81e0708fb82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3660d396-879a-4bb6-ac74-f287aece726a 1073741824" returned: 0 in 0.502s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3660d396-879a-4bb6-ac74-f287aece726a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:46 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5b1fe491-0305-4335-a0bb-329147feacf4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created volume successfully. Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3660d396-879a-4bb6-ac74-f287aece726a" returned: 0 in 0.346s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] <== create_volume: return (869ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942504792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:44Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Creating volume 4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:46 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:46 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=131, name=volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11ccb23-a346-40dd-b80f-d9815d6717d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3660d396-879a-4bb6-ac74-f287aece726a', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d95813-3b4b-484c-863e-38c5c88dd59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd 1073741824" returned: 0 in 0.458s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:47 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume volume-3660d396-879a-4bb6-ac74-f287aece726a (3660d396-879a-4bb6-ac74-f287aece726a): created successfully Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d95813-3b4b-484c-863e-38c5c88dd59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (947a9708-80e9-4a11-8839-dcf6f108e7e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd" returned: 0 in 0.351s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] <== create_volume: return (834ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1265076526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3110fd-731b-4550-9d1a-3323997c1602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e837356b04b64612a309f1db04bc07bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:44Z,use_quota=True,user_id='6fd53900698645a7a6e5d2b630dc86cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Creating volume 3a3110fd-731b-4550-9d1a-3323997c1602 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:47 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a3110fd-731b-4550-9d1a-3323997c1602 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:47 devstack quobyte-client[82625]: System call of process 98664 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:47 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=132, name=volume-3a3110fd-731b-4550-9d1a-3323997c1602, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:47 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-12723f7e-bde7-4c92-8e3a-7bc7bc8799d4 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created volume successfully. Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800902d7-77a3-463e-bb2d-19f38e085dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:47 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0336efd7-3b48-4130-a0ed-d0abc20a97ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd (4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd): created successfully Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0336efd7-3b48-4130-a0ed-d0abc20a97ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (36bbfe4e-c1c9-4a42-962d-db2e3f372ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a3110fd-731b-4550-9d1a-3323997c1602 1073741824" returned: 0 in 0.680s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a3110fd-731b-4550-9d1a-3323997c1602 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9d2187f6-cea0-4d62-90b5-c36d7b7e2261 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created volume successfully. Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a3110fd-731b-4550-9d1a-3323997c1602" returned: 0 in 0.254s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] <== create_volume: return (963ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d0cda9-7709-40b6-baeb-1a8238e423ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3110fd-731b-4550-9d1a-3323997c1602', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4d7ed4-e2bd-4810-be5a-c655b9a0fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:48 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume volume-3a3110fd-731b-4550-9d1a-3323997c1602 (3a3110fd-731b-4550-9d1a-3323997c1602): created successfully Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4d7ed4-e2bd-4810-be5a-c655b9a0fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:48 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Flow 'volume_create_manager' (16644594-d890-4fde-8715-0e8b7287b4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3377b32c-8b16-460f-bd33-fcb57ff031d7 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created volume successfully. Sep 10 17:58:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:49 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-quobyte-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:49 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d092e-8135-4c63-99ef-bcb1824d79e1]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd" returned: 0 in 0.481s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd" returned: 0 in 0.102s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd" released by "delete_volume" :: held 0.750s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:50 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created reservations ['e5b7249a-fb89-461f-be54-5745af0ece1c', '64bf583b-11c7-4097-8c21-308c44bdcec9', 'e0a7e463-76c7-4ac2-adb2-82b8aabd0f26', '9282c54b-0273-43be-a4e8-101bacf4f127'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.255s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:51 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Deleted volume successfully. Sep 10 17:58:51 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Flow 'volume_create_manager' (e83abbe0-7a23-467a-88fc-ed99e220172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbcffdf-c86e-444c-ae9f-bb626e1bafea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbcffdf-c86e-444c-ae9f-bb626e1bafea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-261083803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4bf964-4146-4db4-89bc-4b1b84f3006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51ed882a045436d8da1ba65d9be1bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:51Z,use_quota=True,user_id='ade8ba7c82524638993d7ec6d171ded3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e26c7a3f-5600-4d63-85cb-5cdbff2a2c43),volume_type_id=e26c7a3f-5600-4d63-85cb-5cdbff2a2c43)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7deaf410-1a14-4aec-bbb0-d83be1018d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7deaf410-1a14-4aec-bbb0-d83be1018d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3589748b-3c01-436a-8b72-4a329cb47472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3589748b-3c01-436a-8b72-4a329cb47472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4bf964-4146-4db4-89bc-4b1b84f3006b', 'volume_name': 'volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd6d16e-10c8-47aa-a7eb-c4eab8481a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd6d16e-10c8-47aa-a7eb-c4eab8481a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c405870-64a0-408a-9611-ea82769ee414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:51 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume fa4bf964-4146-4db4-89bc-4b1b84f3006b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b', 'volume_size': 1} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-261083803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4bf964-4146-4db4-89bc-4b1b84f3006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51ed882a045436d8da1ba65d9be1bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:51Z,use_quota=True,user_id='ade8ba7c82524638993d7ec6d171ded3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e26c7a3f-5600-4d63-85cb-5cdbff2a2c43),volume_type_id=e26c7a3f-5600-4d63-85cb-5cdbff2a2c43)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Creating volume fa4bf964-4146-4db4-89bc-4b1b84f3006b {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:51 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-59a3d05c-bade-480b-821f-3245f3166f83 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-4d7ab7ff-72ee-449a-bd2a-f4e2414da6dd-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:51 devstack quobyte-client[82625]: System call of process 98674 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:51 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=133, name=volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-3a3110fd-731b-4550-9d1a-3323997c1602-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:52 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Flow 'volume_create_manager' (3abeb4aa-fb3a-421a-86ab-1c3a125979db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bb916f-f35a-40d2-a474-f6d2351fee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b 1073741824" returned: 0 in 0.736s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-3a3110fd-731b-4550-9d1a-3323997c1602-delete_volume" acquired by "delete_volume" :: waited 0.369s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bb916f-f35a-40d2-a474-f6d2351fee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-210084195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f86b5a-769e-423b-a551-3dec5f5d9aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51ed882a045436d8da1ba65d9be1bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:51Z,use_quota=True,user_id='ade8ba7c82524638993d7ec6d171ded3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(077ab031-eec1-4730-814b-97fa8295d6f9),volume_type_id=077ab031-eec1-4730-814b-97fa8295d6f9)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f97399-7b14-439a-be60-15eb14b8f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f97399-7b14-439a-be60-15eb14b8f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8830dfbf-72d3-4540-a33c-460741808271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8830dfbf-72d3-4540-a33c-460741808271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f86b5a-769e-423b-a551-3dec5f5d9aee', 'volume_name': 'volume-45f86b5a-769e-423b-a551-3dec5f5d9aee', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889c28fa-57ad-45fd-a42a-0122a177cdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889c28fa-57ad-45fd-a42a-0122a177cdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2406e06e-2e35-4922-875e-f8d88e3024df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:52 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume 45f86b5a-769e-423b-a551-3dec5f5d9aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f86b5a-769e-423b-a551-3dec5f5d9aee', 'volume_size': 1} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b" returned: 0 in 0.386s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] <== create_volume: return (1135ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-210084195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f86b5a-769e-423b-a551-3dec5f5d9aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51ed882a045436d8da1ba65d9be1bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:51Z,use_quota=True,user_id='ade8ba7c82524638993d7ec6d171ded3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(077ab031-eec1-4730-814b-97fa8295d6f9),volume_type_id=077ab031-eec1-4730-814b-97fa8295d6f9)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Creating volume 45f86b5a-769e-423b-a551-3dec5f5d9aee {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:58:52 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:58:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:53 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=134, name=volume-45f86b5a-769e-423b-a551-3dec5f5d9aee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:58:53 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Flow 'volume_create_manager' (f59c8ba5-673c-4bd7-8adc-b03541d50889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fbe3d3-f1b9-4110-b157-159f763eca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c405870-64a0-408a-9611-ea82769ee414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70a9bcf-7b4f-4774-bbbe-c915445bf57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:53 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-quobyte-3a3110fd-731b-4550-9d1a-3323997c1602" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:53 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b (fa4bf964-4146-4db4-89bc-4b1b84f3006b): created successfully Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70a9bcf-7b4f-4774-bbbe-c915445bf57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Flow 'volume_create_manager' (e83abbe0-7a23-467a-88fc-ed99e220172b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fbe3d3-f1b9-4110-b157-159f763eca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-515070705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd216258-a062-40ec-b364-3ed53ad487a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51ed882a045436d8da1ba65d9be1bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:52Z,use_quota=True,user_id='ade8ba7c82524638993d7ec6d171ded3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a0555f2-26a5-46a6-93df-de6df6531b80),volume_type_id=5a0555f2-26a5-46a6-93df-de6df6531b80)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7251abec-5d83-4c58-a267-f349616c62db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7251abec-5d83-4c58-a267-f349616c62db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4513264-4530-4fbc-be6b-07f75a7c03f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee 1073741824" returned: 0 in 0.676s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-3a3110fd-731b-4550-9d1a-3323997c1602" acquired by "delete_volume" :: waited 0.374s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[174a7008-e622-430e-85d0-feb5ad89d9a8]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:53 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9f0bb291-d60d-438a-b7c3-5d2aaef78874 tempest-TestInstancesWithCinderVolumes-1867475660 None] Created volume successfully. Sep 10 17:58:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a3110fd-731b-4550-9d1a-3323997c1602 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee" returned: 0 in 0.804s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] <== create_volume: return (1723ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2406e06e-2e35-4922-875e-f8d88e3024df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f86b5a-769e-423b-a551-3dec5f5d9aee', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f41727-d411-472a-9186-8bd2aecbbe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:54 devstack quobyte-client[82625]: System call of process 98695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4513264-4530-4fbc-be6b-07f75a7c03f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd216258-a062-40ec-b364-3ed53ad487a2', 'volume_name': 'volume-cd216258-a062-40ec-b364-3ed53ad487a2', 'volume_size': 1, 'image_id': 'f92fb851-b7e6-467a-859a-a29ca5bc2827', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--359692591', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51ed882a045436d8da1ba65d9be1bdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f92fb851-b7e6-467a-859a-a29ca5bc2827', 'created_at': datetime.datetime(2025, 9, 10, 15, 58, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f92fb851-b7e6-467a-859a-a29ca5bc2827/file', 'properties': {}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e206588a-afec-4363-86e2-be25db6fbaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e206588a-afec-4363-86e2-be25db6fbaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e76cba-934e-40e3-8fe9-fd8c12b1e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:58:54 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume cd216258-a062-40ec-b364-3ed53ad487a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd216258-a062-40ec-b364-3ed53ad487a2', 'volume_size': 1, 'image_id': 'f92fb851-b7e6-467a-859a-a29ca5bc2827', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--359692591', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51ed882a045436d8da1ba65d9be1bdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f92fb851-b7e6-467a-859a-a29ca5bc2827', 'created_at': datetime.datetime(2025, 9, 10, 15, 58, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f92fb851-b7e6-467a-859a-a29ca5bc2827/file', 'properties': {}}, 'image_service': } Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Cloning cd216258-a062-40ec-b364-3ed53ad487a2 from image f92fb851-b7e6-467a-859a-a29ca5bc2827 at location (None, None). {{(pid=82609) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a3110fd-731b-4550-9d1a-3323997c1602" returned: 0 in 0.859s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a3110fd-731b-4550-9d1a-3323997c1602 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:55 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume volume-45f86b5a-769e-423b-a551-3dec5f5d9aee (45f86b5a-769e-423b-a551-3dec5f5d9aee): created successfully Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f41727-d411-472a-9186-8bd2aecbbe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Flow 'volume_create_manager' (3abeb4aa-fb3a-421a-86ab-1c3a125979db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a3110fd-731b-4550-9d1a-3323997c1602" returned: 0 in 0.431s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:55 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d4a86531-4880-461b-8aad-76d58cdca9eb tempest-TestInstancesWithCinderVolumes-1867475660 None] Created volume successfully. Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-3a3110fd-731b-4550-9d1a-3323997c1602" released by "delete_volume" :: held 1.537s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created reservations ['d1433b1c-7815-4362-be63-8ae9ec038563', 'fa659953-6745-409e-b1d9-e0988917e3ae', 'e9ebc5ef-74bd-46d7-8c52-d8b6dbd0e2fb', '063d6e72-f551-43c8-a7fe-5b0ab76e30ab'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.096s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:55 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Deleted volume successfully. Sep 10 17:58:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6ff77219-b9cd-41bf-861c-6cc70340954c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-3a3110fd-731b-4550-9d1a-3323997c1602-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-3660d396-879a-4bb6-ac74-f287aece726a-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-3660d396-879a-4bb6-ac74-f287aece726a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-quobyte-3660d396-879a-4bb6-ac74-f287aece726a" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-3660d396-879a-4bb6-ac74-f287aece726a" acquired by "delete_volume" :: waited 0.014s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:56 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3dcf0b-b99b-44d6-8a30-a45f3a19ae5b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3660d396-879a-4bb6-ac74-f287aece726a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3660d396-879a-4bb6-ac74-f287aece726a" returned: 0 in 0.451s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3660d396-879a-4bb6-ac74-f287aece726a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3660d396-879a-4bb6-ac74-f287aece726a" returned: 0 in 0.120s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-3660d396-879a-4bb6-ac74-f287aece726a" released by "delete_volume" :: held 0.713s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created reservations ['4e4a2e07-d282-41b1-b11b-f79c836a42ff', 'b728d7f0-9bce-495c-a176-9c487602b864', 'ca7b481e-a496-4a5e-91c0-a63109a7aa5c', '9de23f62-afca-4a33-9d00-8cc3a980443c'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.121s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:57 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:58:57 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Deleted volume successfully. Sep 10 17:58:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6849536e-a1c0-4f39-92c1-fdc43003a951 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-3660d396-879a-4bb6-ac74-f287aece726a-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:58:58 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD, size 20.69 MB, duration 3.78 sec {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 17:58:58 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Image download 20.69 MB at 5.47 MB/s Sep 10 17:58:58 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3351afe-e397-4d24-b4d6-42dfbe3e217e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:DELETE=12,cinder:SELECT=94,cinder:INSERT=33,cinder:UPDATE=148 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=64,cinder:UPDATE=109,cinder:INSERT=19,cinder:DELETE=14 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:58:59 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD Sep 10 17:58:59 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:58:59 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-quobyte-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef" acquired by "delete_volume" :: waited 0.017s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef182c7a-6e78-4bb9-a31d-04ae512e08a9]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef" returned: 0 in 0.468s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:58:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef" returned: 0 in 0.128s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef" released by "delete_volume" :: held 0.781s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created reservations ['3884da6c-c0c6-47b8-949c-48b25736e805', '99c9c356-d774-49cd-bea1-4bd022dcf2f5', '88b6e672-bb32-48d4-911d-eb1f889bd261', '7df150c5-0c9a-46a0-8715-50928f0bc1bc'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.111s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:00 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:59:00 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Deleted volume successfully. Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-362f94cf-0515-418e-9105-2e09d5e9f1b8 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-1d867ad4-9d93-44c3-aca7-4c6d2d5159ef-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-26882ffe-3449-47b4-a043-b42eecbf0c38-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-26882ffe-3449-47b4-a043-b42eecbf0c38-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:59:01 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-quobyte-26882ffe-3449-47b4-a043-b42eecbf0c38" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-26882ffe-3449-47b4-a043-b42eecbf0c38" acquired by "delete_volume" :: waited 0.017s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c5710e-ddff-441d-8bbb-c390f27eb59a]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-26882ffe-3449-47b4-a043-b42eecbf0c38 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:01 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD" returned: 0 in 2.959s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:01 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Temporary image f92fb851-b7e6-467a-859a-a29ca5bc2827 is fetched for user ade8ba7c82524638993d7ec6d171ded3. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cb5702-d6df-49b2-b816-38ba824922a4]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-26882ffe-3449-47b4-a043-b42eecbf0c38" returned: 0 in 0.606s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-26882ffe-3449-47b4-a043-b42eecbf0c38 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-26882ffe-3449-47b4-a043-b42eecbf0c38" returned: 0 in 0.135s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-26882ffe-3449-47b4-a043-b42eecbf0c38" released by "delete_volume" :: held 0.949s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:59:02 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD Sep 10 17:59:02 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created reservations ['1d32de9d-9d00-443e-b34c-50db7d365653', '9a10d26a-784b-4eb4-a985-73a0f1a4465d', '0e128543-23e8-4815-8ddb-f7760cf79ade', '9d03a532-f76f-4e39-b86d-8456bbac9026'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.101s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:03 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:59:03 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Deleted volume successfully. Sep 10 17:59:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-647a6219-31f3-4331-97ad-9e95505f0f8c tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-26882ffe-3449-47b4-a043-b42eecbf0c38-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:59:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-83eea769-ff24-445b-94fc-55d5921cc868-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:59:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-83eea769-ff24-445b-94fc-55d5921cc868-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:59:03 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:59:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "cinder-quobyte-83eea769-ff24-445b-94fc-55d5921cc868" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 17:59:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-83eea769-ff24-445b-94fc-55d5921cc868" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 17:59:03 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3876c6f7-a669-4eed-a48e-7379ddbd02bc]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:59:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83eea769-ff24-445b-94fc-55d5921cc868 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83eea769-ff24-445b-94fc-55d5921cc868" returned: 0 in 0.632s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83eea769-ff24-445b-94fc-55d5921cc868 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-83eea769-ff24-445b-94fc-55d5921cc868" returned: 0 in 0.139s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:04 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-quobyte-83eea769-ff24-445b-94fc-55d5921cc868" released by "delete_volume" :: held 1.009s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD" returned: 0 in 2.799s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T15:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-515070705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd216258-a062-40ec-b364-3ed53ad487a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51ed882a045436d8da1ba65d9be1bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:58:52Z,use_quota=True,user_id='ade8ba7c82524638993d7ec6d171ded3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a0555f2-26a5-46a6-93df-de6df6531b80),volume_type_id=5a0555f2-26a5-46a6-93df-de6df6531b80)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Creating volume cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 17:59:04 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 17:59:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:05 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=135, name=volume-cd216258-a062-40ec-b364-3ed53ad487a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 1073741824" returned: 0 in 0.380s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 0 in 0.127s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] <== create_volume: return (564ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.587s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Created reservations ['2ab0f029-273c-49d6-83ce-86e9ff4ac434', '2bfc5fd8-6922-4373-ba50-cf1bde76091c', '896de2c0-3cad-43d1-8976-98e6ae27c776', '1d5091c9-39da-4eee-abb4-e6b8a25cdee3'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Attempting download of f92fb851-b7e6-467a-859a-a29ca5bc2827 ((None, None)) to volume cd216258-a062-40ec-b364-3ed53ad487a2. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d845a-cd33-44ed-add2-6288baca3e25]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f92fb851-b7e6-467a-859a-a29ca5bc2827_c0airxnm {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:59:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.108s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:59:06 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Deleted volume successfully. Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f92fb851-b7e6-467a-859a-a29ca5bc2827_c0airxnm" returned: 0 in 0.524s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f92fb851-b7e6-467a-859a-a29ca5bc2827_c0airxnm {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1cd25d34-82d9-4778-b973-a29a4f8c56c0 tempest-CreateVolumesFromSourceVolumeTest-1016963644 None] Lock "cinder-83eea769-ff24-445b-94fc-55d5921cc868-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f92fb851-b7e6-467a-859a-a29ca5bc2827_c0airxnm" returned: 1 in 0.390s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f92fb851-b7e6-467a-859a-a29ca5bc2827_c0airxnm' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9238f4-fbf6-441e-b932-1d8d6866fb40]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:59:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:07 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] f92fb851-b7e6-467a-859a-a29ca5bc2827 was qcow2, converting to raw {{(pid=82609) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 17:59:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:07 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=135, name=volume-cd216258-a062-40ec-b364-3ed53ad487a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 17:59:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 0 in 1.061s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:08 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f92fb851-b7e6-467a-859a-a29ca5bc2827_razhzrnvdevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 17:59:08 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Converted 112.00 MB image at 102.53 MB/s Sep 10 17:59:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 1G" returned: 0 in 0.165s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:08 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d448b-8ab1-49e5-988e-1fb715f3a596]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:59:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 0 in 0.438s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 1 in 0.377s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Downloaded image f92fb851-b7e6-467a-859a-a29ca5bc2827 ((None, None)) to volume cd216258-a062-40ec-b364-3ed53ad487a2 successfully. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Temporary image f92fb851-b7e6-467a-859a-a29ca5bc2827 for user ade8ba7c82524638993d7ec6d171ded3 is deleted. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Marking volume cd216258-a062-40ec-b364-3ed53ad487a2 as bootable. {{(pid=82609) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Copying metadata from image f92fb851-b7e6-467a-859a-a29ca5bc2827 to cd216258-a062-40ec-b364-3ed53ad487a2. {{(pid=82609) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Creating volume glance metadata for volume cd216258-a062-40ec-b364-3ed53ad487a2 backed by image f92fb851-b7e6-467a-859a-a29ca5bc2827 with: {'image_id': 'f92fb851-b7e6-467a-859a-a29ca5bc2827', 'image_name': 'tempest-scenario-img--359692591', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82609) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e76cba-934e-40e3-8fe9-fd8c12b1e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd216258-a062-40ec-b364-3ed53ad487a2', 'volume_size': 1, 'image_id': 'f92fb851-b7e6-467a-859a-a29ca5bc2827', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--359692591', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51ed882a045436d8da1ba65d9be1bdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f92fb851-b7e6-467a-859a-a29ca5bc2827', 'created_at': datetime.datetime(2025, 9, 10, 15, 58, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f92fb851-b7e6-467a-859a-a29ca5bc2827/file', 'properties': {}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c203885b-a61a-469b-afc5-1a7378a3837b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 17:59:09 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume volume-cd216258-a062-40ec-b364-3ed53ad487a2 (cd216258-a062-40ec-b364-3ed53ad487a2): created successfully Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c203885b-a61a-469b-afc5-1a7378a3837b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 17:59:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Flow 'volume_create_manager' (f59c8ba5-673c-4bd7-8adc-b03541d50889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 17:59:09 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2a5d828c-0435-4b63-a9b8-b6bcbce32e77 tempest-TestInstancesWithCinderVolumes-1867475660 None] Created volume successfully. Sep 10 17:59:19 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=20,cinder:INSERT=13,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:59:19 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:59:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:59:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:59:20 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cdba88-e701-482b-9bd9-a5de94ef9408]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 17:59:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 0 in 0.477s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 1 in 0.521s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 17:59:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.106s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:59:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-cd216258-a062-40ec-b364-3ed53ad487a2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0925e643-3769-4a40-8d7d-5888aaf41d3b', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 17:59:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 17:59:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-03cb006d-6f2c-4ef1-9d01-1acb7b1b1dae req-80194131-fc38-4179-a6f9-bbce59ae88c7 tempest-TestInstancesWithCinderVolumes-1867475660 None] attachment_update completed successfully. Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.088s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 17:59:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 17:59:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 17:59:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.129s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:00:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:00:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-de05f645-d82e-445c-b1b8-5d8c1ddda321 req-3096435d-d5bf-496b-89c4-c6bb094376cd tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:00:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-de05f645-d82e-445c-b1b8-5d8c1ddda321 req-3096435d-d5bf-496b-89c4-c6bb094376cd tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:00:31 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c740eebb-27a6-4866-9df1-7a92246714a9]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:00:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-de05f645-d82e-445c-b1b8-5d8c1ddda321 req-3096435d-d5bf-496b-89c4-c6bb094376cd tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:00:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-de05f645-d82e-445c-b1b8-5d8c1ddda321 req-3096435d-d5bf-496b-89c4-c6bb094376cd tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b" returned: 0 in 0.515s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:00:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-de05f645-d82e-445c-b1b8-5d8c1ddda321 req-3096435d-d5bf-496b-89c4-c6bb094376cd tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.585s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:00:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-de05f645-d82e-445c-b1b8-5d8c1ddda321 req-3096435d-d5bf-496b-89c4-c6bb094376cd tempest-TestInstancesWithCinderVolumes-1867475660 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5ad129f-5c0e-4f7f-bc29-7c6e0cc81f45', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 18:00:32 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-de05f645-d82e-445c-b1b8-5d8c1ddda321 req-3096435d-d5bf-496b-89c4-c6bb094376cd tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:00:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-de05f645-d82e-445c-b1b8-5d8c1ddda321 req-3096435d-d5bf-496b-89c4-c6bb094376cd tempest-TestInstancesWithCinderVolumes-1867475660 None] attachment_update completed successfully. Sep 10 18:00:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-16383dd8-63c8-4ed3-8804-e5bbee37c6a8 req-dc480452-59ac-45ae-9c01-4adc71580355 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:00:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-16383dd8-63c8-4ed3-8804-e5bbee37c6a8 req-dc480452-59ac-45ae-9c01-4adc71580355 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:00:42 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f21745-4cce-4bed-8604-3caf56277f95]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:00:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-16383dd8-63c8-4ed3-8804-e5bbee37c6a8 req-dc480452-59ac-45ae-9c01-4adc71580355 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:00:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-16383dd8-63c8-4ed3-8804-e5bbee37c6a8 req-dc480452-59ac-45ae-9c01-4adc71580355 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee" returned: 0 in 0.371s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:00:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-16383dd8-63c8-4ed3-8804-e5bbee37c6a8 req-dc480452-59ac-45ae-9c01-4adc71580355 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.419s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:00:43 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-16383dd8-63c8-4ed3-8804-e5bbee37c6a8 req-dc480452-59ac-45ae-9c01-4adc71580355 tempest-TestInstancesWithCinderVolumes-1867475660 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-45f86b5a-769e-423b-a551-3dec5f5d9aee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12255184-8cba-4b7e-ae97-610f3fa5f7ac', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 18:00:43 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-16383dd8-63c8-4ed3-8804-e5bbee37c6a8 req-dc480452-59ac-45ae-9c01-4adc71580355 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:00:43 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-16383dd8-63c8-4ed3-8804-e5bbee37c6a8 req-dc480452-59ac-45ae-9c01-4adc71580355 tempest-TestInstancesWithCinderVolumes-1867475660 None] attachment_update completed successfully. Sep 10 18:00:53 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:00:53 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:01:16 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-28459bce-e459-4efb-a6c3-4eac6fe556fd req-5a936b4b-c7a8-4052-8ca8-adf5a83b5ddb tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:01:16 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-28459bce-e459-4efb-a6c3-4eac6fe556fd req-5a936b4b-c7a8-4052-8ca8-adf5a83b5ddb tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:01:16 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-28459bce-e459-4efb-a6c3-4eac6fe556fd req-5a936b4b-c7a8-4052-8ca8-adf5a83b5ddb tempest-TestInstancesWithCinderVolumes-1867475660 None] Terminate volume connection completed successfully. Sep 10 18:01:16 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-28459bce-e459-4efb-a6c3-4eac6fe556fd req-5a936b4b-c7a8-4052-8ca8-adf5a83b5ddb tempest-TestInstancesWithCinderVolumes-1867475660 None] Deleting attachment c5ad129f-5c0e-4f7f-bc29-7c6e0cc81f45. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 18:01:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "cinder-fa4bf964-4146-4db4-89bc-4b1b84f3006b-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:01:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-fa4bf964-4146-4db4-89bc-4b1b84f3006b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:01:17 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:01:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "cinder-quobyte-fa4bf964-4146-4db4-89bc-4b1b84f3006b" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:01:17 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-quobyte-fa4bf964-4146-4db4-89bc-4b1b84f3006b" acquired by "delete_volume" :: waited 0.013s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:01:17 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443daa2-763b-4bbb-a8e9-397e029ca97b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:01:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:01:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b" returned: 0 in 0.543s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:01:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:01:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fa4bf964-4146-4db4-89bc-4b1b84f3006b" returned: 0 in 0.090s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:01:18 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-quobyte-fa4bf964-4146-4db4-89bc-4b1b84f3006b" released by "delete_volume" :: held 0.778s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:01:18 devstack cinder-volume[82609]: WARNING cinder.quota [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-114200448-743124293 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-114200448-743124293, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:01:18 devstack cinder-volume[82609]: WARNING cinder.quota [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-114200448-743124293 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-114200448-743124293, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Created reservations ['bd4f4ee5-72f7-4756-8061-15fb86509c10', 'cd7bd515-d455-4d14-a309-b480097027c3', '2ef3db0c-4e7c-44eb-8189-92d9796b393f', '4e231794-b2fc-4928-b641-648cafb52b3a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.083s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:01:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Deleted volume successfully. Sep 10 18:01:19 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-eb19cb1a-9d44-48db-b874-b324e01c9f2f tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-fa4bf964-4146-4db4-89bc-4b1b84f3006b-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.081s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:01:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:01:29 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=4 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:01:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:01:46 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-70e12363-af48-4688-9aff-8f013f5eb2f5 req-450e1d9b-a9f2-46a2-b05a-c26f69e9a90c tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:01:46 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-70e12363-af48-4688-9aff-8f013f5eb2f5 req-450e1d9b-a9f2-46a2-b05a-c26f69e9a90c tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:01:46 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-70e12363-af48-4688-9aff-8f013f5eb2f5 req-450e1d9b-a9f2-46a2-b05a-c26f69e9a90c tempest-TestInstancesWithCinderVolumes-1867475660 None] Terminate volume connection completed successfully. Sep 10 18:01:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-70e12363-af48-4688-9aff-8f013f5eb2f5 req-450e1d9b-a9f2-46a2-b05a-c26f69e9a90c tempest-TestInstancesWithCinderVolumes-1867475660 None] Deleting attachment 12255184-8cba-4b7e-ae97-610f3fa5f7ac. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 18:01:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "cinder-45f86b5a-769e-423b-a551-3dec5f5d9aee-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:01:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-45f86b5a-769e-423b-a551-3dec5f5d9aee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:01:48 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:01:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "cinder-quobyte-45f86b5a-769e-423b-a551-3dec5f5d9aee" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:01:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-quobyte-45f86b5a-769e-423b-a551-3dec5f5d9aee" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:01:48 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2a46b6-53ba-4c98-8a84-ded8e764b47a]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:01:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee" returned: 0 in 0.475s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-45f86b5a-769e-423b-a551-3dec5f5d9aee" returned: 0 in 0.088s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-quobyte-45f86b5a-769e-423b-a551-3dec5f5d9aee" released by "delete_volume" :: held 0.747s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:01:49 devstack cinder-volume[82609]: WARNING cinder.quota [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1053708790-509815678 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1053708790-509815678, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:01:49 devstack cinder-volume[82609]: WARNING cinder.quota [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1053708790-509815678 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1053708790-509815678, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Created reservations ['3ffd6bbc-c63f-4041-9af2-90522a5cfb68', 'cedb70fb-39d1-4786-948f-403f16f04412', '1b89ad09-ce4f-49c5-9888-ba47baedb763', '7a6e8b30-8112-4234-a5ad-745a88c188b4'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:01:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:01:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.103s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:01:50 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:01:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Deleted volume successfully. Sep 10 18:01:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8654c79f-6f72-47a1-9a4a-c36b86b217e0 tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-45f86b5a-769e-423b-a551-3dec5f5d9aee-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:01:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-22875eec-11af-40ed-b783-02df8c6ea104 req-ead1a903-e891-4f22-8d84-d51208627cf3 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:01:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-22875eec-11af-40ed-b783-02df8c6ea104 req-ead1a903-e891-4f22-8d84-d51208627cf3 tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:01:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-22875eec-11af-40ed-b783-02df8c6ea104 req-ead1a903-e891-4f22-8d84-d51208627cf3 tempest-TestInstancesWithCinderVolumes-1867475660 None] Terminate volume connection completed successfully. Sep 10 18:01:56 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-22875eec-11af-40ed-b783-02df8c6ea104 req-ead1a903-e891-4f22-8d84-d51208627cf3 tempest-TestInstancesWithCinderVolumes-1867475660 None] Deleting attachment 0925e643-3769-4a40-8d7d-5888aaf41d3b. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 18:02:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "cinder-cd216258-a062-40ec-b364-3ed53ad487a2-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:02:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-cd216258-a062-40ec-b364-3ed53ad487a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:02:00 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:02:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "cinder-quobyte-cd216258-a062-40ec-b364-3ed53ad487a2" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:02:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-quobyte-cd216258-a062-40ec-b364-3ed53ad487a2" acquired by "delete_volume" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:02:01 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1764fc8-dda1-4f3d-816f-7220d50d24e4]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:02:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:02:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 0 in 0.336s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:02:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:02:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 1 in 0.387s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:02:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:02:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:02:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cd216258-a062-40ec-b364-3ed53ad487a2" returned: 0 in 0.074s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-quobyte-cd216258-a062-40ec-b364-3ed53ad487a2" released by "delete_volume" :: held 1.049s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:02:02 devstack cinder-volume[82609]: WARNING cinder.quota [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1354857759-1462201477 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1354857759-1462201477, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:02:02 devstack cinder-volume[82609]: WARNING cinder.quota [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1354857759-1462201477 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1354857759-1462201477, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Created reservations ['b45ec3fc-fbc2-405b-a389-5d90b6ae4c33', '4253590d-31bc-4cb4-868d-6ec5556e6ea7', '965ae449-5027-42ff-b0fb-cac0c188b3c4', 'b52d5dbf-ca04-49d0-afbe-d97ff238f36a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.078s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:02:02 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Deleted volume successfully. Sep 10 18:02:02 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-51c7e640-52b4-459d-aab2-087110afa46b tempest-TestInstancesWithCinderVolumes-1867475660 None] Lock "cinder-cd216258-a062-40ec-b364-3ed53ad487a2-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:02:12 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=6 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:02:12 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=14,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.105s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:02:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:03:03 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:03:03 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:03:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Flow 'volume_create_manager' (c8b346c8-dc3f-40ef-8a63-c3c5ec481cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:03:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6479bd22-de09-4004-84ee-f91a6e9acf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6479bd22-de09-4004-84ee-f91a6e9acf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2081834449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49df5be6-f781-4172-b8c3-2010a4f75fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daea17db3ec042eb8ec1a1759f031a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:03:04Z,use_quota=True,user_id='6f839285d5254a968730130e832371d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4119ec-e493-4dd2-ae5d-1d4dd1ff7ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4119ec-e493-4dd2-ae5d-1d4dd1ff7ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217d87f2-7aec-4cec-a11a-fffcd54834ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217d87f2-7aec-4cec-a11a-fffcd54834ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49df5be6-f781-4172-b8c3-2010a4f75fe5', 'volume_name': 'volume-49df5be6-f781-4172-b8c3-2010a4f75fe5', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459f64e4-443b-4a10-ade4-2f6af7960fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459f64e4-443b-4a10-ade4-2f6af7960fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034f6c9b-850e-4fc8-8fea-5a18366a4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:03:04 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Volume 49df5be6-f781-4172-b8c3-2010a4f75fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49df5be6-f781-4172-b8c3-2010a4f75fe5', 'volume_size': 1} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2081834449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49df5be6-f781-4172-b8c3-2010a4f75fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daea17db3ec042eb8ec1a1759f031a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:03:04Z,use_quota=True,user_id='6f839285d5254a968730130e832371d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Creating volume 49df5be6-f781-4172-b8c3-2010a4f75fe5 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:03:04 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:03:04 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=136, name=volume-49df5be6-f781-4172-b8c3-2010a4f75fe5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5 1073741824" returned: 0 in 0.378s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5" returned: 0 in 0.089s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] <== create_volume: return (533ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.546s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034f6c9b-850e-4fc8-8fea-5a18366a4484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49df5be6-f781-4172-b8c3-2010a4f75fe5', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821a9894-b64d-4626-b1de-19217d936995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:03:04 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Volume volume-49df5be6-f781-4172-b8c3-2010a4f75fe5 (49df5be6-f781-4172-b8c3-2010a4f75fe5): created successfully Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821a9894-b64d-4626-b1de-19217d936995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:03:04 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Flow 'volume_create_manager' (c8b346c8-dc3f-40ef-8a63-c3c5ec481cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:03:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4fa11141-1c9d-4f40-8c9d-d1a6c98f1963 tempest-TestMinimumBasicScenario-1232538542 None] Created volume successfully. Sep 10 18:03:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-f1a038d7-804c-4613-a3f6-96fe0de1fdf6 req-1144e480-05db-4223-8d60-3c513a94a2a2 tempest-TestMinimumBasicScenario-1232538542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:03:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-f1a038d7-804c-4613-a3f6-96fe0de1fdf6 req-1144e480-05db-4223-8d60-3c513a94a2a2 tempest-TestMinimumBasicScenario-1232538542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:03:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d88e6-a6ca-437d-9f80-c7a813f1783f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:03:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-f1a038d7-804c-4613-a3f6-96fe0de1fdf6 req-1144e480-05db-4223-8d60-3c513a94a2a2 tempest-TestMinimumBasicScenario-1232538542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:03:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [req-f1a038d7-804c-4613-a3f6-96fe0de1fdf6 req-1144e480-05db-4223-8d60-3c513a94a2a2 tempest-TestMinimumBasicScenario-1232538542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5" returned: 0 in 0.480s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:03:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [req-f1a038d7-804c-4613-a3f6-96fe0de1fdf6 req-1144e480-05db-4223-8d60-3c513a94a2a2 tempest-TestMinimumBasicScenario-1232538542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.539s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:03:10 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-f1a038d7-804c-4613-a3f6-96fe0de1fdf6 req-1144e480-05db-4223-8d60-3c513a94a2a2 tempest-TestMinimumBasicScenario-1232538542 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474', 'name': 'volume-49df5be6-f781-4172-b8c3-2010a4f75fe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a316227-5af9-44d4-b45a-d00ea7ae11f9', 'enforce_multipath': True} {{(pid=82609) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 18:03:10 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-f1a038d7-804c-4613-a3f6-96fe0de1fdf6 req-1144e480-05db-4223-8d60-3c513a94a2a2 tempest-TestMinimumBasicScenario-1232538542 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:03:10 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-f1a038d7-804c-4613-a3f6-96fe0de1fdf6 req-1144e480-05db-4223-8d60-3c513a94a2a2 tempest-TestMinimumBasicScenario-1232538542 None] attachment_update completed successfully. Sep 10 18:03:20 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:03:20 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.095s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:03:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:03:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:03:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.087s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:04:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.089s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:05:27 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:05:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:05:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:05:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-ac41f933-1324-4146-9377-3ba31ebcecc2 req-49e603dc-4991-48e1-9785-9c620e8af9fe tempest-TestMinimumBasicScenario-1232538542 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:05:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [req-ac41f933-1324-4146-9377-3ba31ebcecc2 req-49e603dc-4991-48e1-9785-9c620e8af9fe tempest-TestMinimumBasicScenario-1232538542 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:05:46 devstack cinder-volume[82609]: INFO cinder.volume.manager [req-ac41f933-1324-4146-9377-3ba31ebcecc2 req-49e603dc-4991-48e1-9785-9c620e8af9fe tempest-TestMinimumBasicScenario-1232538542 None] Terminate volume connection completed successfully. Sep 10 18:05:46 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [req-ac41f933-1324-4146-9377-3ba31ebcecc2 req-49e603dc-4991-48e1-9785-9c620e8af9fe tempest-TestMinimumBasicScenario-1232538542 None] Deleting attachment 7a316227-5af9-44d4-b45a-d00ea7ae11f9. {{(pid=82609) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 18:05:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Acquiring lock "cinder-49df5be6-f781-4172-b8c3-2010a4f75fe5-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:05:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Lock "cinder-49df5be6-f781-4172-b8c3-2010a4f75fe5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:05:47 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:05:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Acquiring lock "cinder-quobyte-49df5be6-f781-4172-b8c3-2010a4f75fe5" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:05:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Lock "cinder-quobyte-49df5be6-f781-4172-b8c3-2010a4f75fe5" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:05:47 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd60d40-7683-4b30-a828-529286309396]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:05:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:05:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5" returned: 0 in 0.453s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:05:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-49df5be6-f781-4172-b8c3-2010a4f75fe5" returned: 0 in 0.099s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Lock "cinder-quobyte-49df5be6-f781-4172-b8c3-2010a4f75fe5" released by "delete_volume" :: held 0.712s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Created reservations ['7e835ce1-a1ae-4ae3-a391-9080e05bce9e', 'f6a1c5f8-d3e0-43ad-8fab-76e65ea6995a', '6916f797-baad-4cdd-a0e8-1918ded33755', '50274bfb-b6df-49c8-8545-17f7da2e14b5'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.103s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:05:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Deleted volume successfully. Sep 10 18:05:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ca12b46-e0a7-4a77-a4ff-8e4b30de816a tempest-TestMinimumBasicScenario-1232538542 None] Lock "cinder-49df5be6-f781-4172-b8c3-2010a4f75fe5-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:05:58 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:05:58 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:06:12 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (bc5920bf-ee10-44be-adb2-7b28567205ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d27121-5b9c-4138-87a4-cd273b6d83c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d27121-5b9c-4138-87a4-cd273b6d83c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-232160976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ff84f3-ae2b-4304-ab60-7a2baf936265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:12Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40680c9-88a5-4c01-b19a-72c7fd753fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40680c9-88a5-4c01-b19a-72c7fd753fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544fec10-b791-4c06-bf32-0f127db2eab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544fec10-b791-4c06-bf32-0f127db2eab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ff84f3-ae2b-4304-ab60-7a2baf936265', 'volume_name': 'volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10aec488-ac72-4f9a-9d57-1d39e14be7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10aec488-ac72-4f9a-9d57-1d39e14be7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42f291b-7282-4975-842a-d6deee908e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:12 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume c8ff84f3-ae2b-4304-ab60-7a2baf936265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265', 'volume_size': 1} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-232160976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ff84f3-ae2b-4304-ab60-7a2baf936265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:12Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Creating volume c8ff84f3-ae2b-4304-ab60-7a2baf936265 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:06:12 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:12 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=137, name=volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 1073741824" returned: 0 in 0.330s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:12 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265" returned: 0 in 0.076s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:13 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] <== create_volume: return (472ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:06:13 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.485s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:13 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42f291b-7282-4975-842a-d6deee908e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:13 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a81040e-678e-4d8d-a1ea-c73d6c421309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:13 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 (c8ff84f3-ae2b-4304-ab60-7a2baf936265): created successfully Sep 10 18:06:13 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a81040e-678e-4d8d-a1ea-c73d6c421309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:13 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (bc5920bf-ee10-44be-adb2-7b28567205ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:13 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4540c9ba-7107-477c-b846-c3cdc1dbcf40 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created volume successfully. Sep 10 18:06:14 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:14 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Creating offline snapshot 0525ef57-f137-4b27-9407-dc7951b30c64 of volume c8ff84f3-ae2b-4304-ab60-7a2baf936265 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 18:06:14 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85e57dd-06db-4ddb-b05c-b7f6051b844d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265" returned: 0 in 0.396s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:15 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=138, name=volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 1G" returned: 0 in 0.261s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img rebase -u -b volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64" returned: 0 in 0.117s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64" returned: 0 in 0.083s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64" returned: 0 in 0.099s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:15 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.info" returned: 0 in 0.086s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:16 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:06:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.info" returned: 0 in 0.080s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:16 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.409s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:16 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5231b00b-2cec-4567-9ec4-c0c596bf8067 tempest-CreateVolumesFromSnapshotTest-503331301 None] Create snapshot completed successfully Sep 10 18:06:17 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (9762d3b6-2c0c-4bc0-916b-e9981b5bbf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181c91c1-921f-44d5-97e3-7e7bfcb3aacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181c91c1-921f-44d5-97e3-7e7bfcb3aacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828631439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f7f446-e474-4ff1-ad17-0c97da936e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:17Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a24831d-54ce-4627-9e4e-a602fb6d7b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a24831d-54ce-4627-9e4e-a602fb6d7b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c837c198-8252-4801-884c-5b0447255273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c837c198-8252-4801-884c-5b0447255273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f7f446-e474-4ff1-ad17-0c97da936e8c', 'volume_name': 'volume-64f7f446-e474-4ff1-ad17-0c97da936e8c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a81f9ec-e32c-45f8-b420-f145b8547583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a81f9ec-e32c-45f8-b420-f145b8547583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f8e76c-e222-4be5-ad28-29210bc6b40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:17 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume 64f7f446-e474-4ff1-ad17-0c97da936e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f7f446-e474-4ff1-ad17-0c97da936e8c', 'volume_size': 1} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828631439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f7f446-e474-4ff1-ad17-0c97da936e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:17Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Creating volume 64f7f446-e474-4ff1-ad17-0c97da936e8c {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:06:17 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-64f7f446-e474-4ff1-ad17-0c97da936e8c 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:17 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=140, name=volume-64f7f446-e474-4ff1-ad17-0c97da936e8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-64f7f446-e474-4ff1-ad17-0c97da936e8c 1073741824" returned: 0 in 0.482s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:17 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-64f7f446-e474-4ff1-ad17-0c97da936e8c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:18 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (f149f9b3-cb9a-4a56-b04d-03c68db0eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884bd769-3cb0-4c35-a4c3-f7360d44b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-64f7f446-e474-4ff1-ad17-0c97da936e8c" returned: 0 in 0.520s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] <== create_volume: return (1039ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884bd769-3cb0-4c35-a4c3-f7360d44b177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95691160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8fb1ff-fef7-4691-972c-7c15bada6725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:18Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5d975a-00ab-4ebc-978a-1512db33f0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5d975a-00ab-4ebc-978a-1512db33f0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f01314-fe6e-4181-a5c0-dc3e7afd6fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f01314-fe6e-4181-a5c0-dc3e7afd6fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8fb1ff-fef7-4691-972c-7c15bada6725', 'volume_name': 'volume-da8fb1ff-fef7-4691-972c-7c15bada6725', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed233bef-a146-441d-809c-58bd4e3fb609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed233bef-a146-441d-809c-58bd4e3fb609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef025adf-1cc0-427e-b3f1-9e8fe2073f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:18 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume da8fb1ff-fef7-4691-972c-7c15bada6725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8fb1ff-fef7-4691-972c-7c15bada6725', 'volume_size': 1} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95691160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8fb1ff-fef7-4691-972c-7c15bada6725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:18Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Creating volume da8fb1ff-fef7-4691-972c-7c15bada6725 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:06:18 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-da8fb1ff-fef7-4691-972c-7c15bada6725 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:18 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=141, name=volume-da8fb1ff-fef7-4691-972c-7c15bada6725, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f8e76c-e222-4be5-ad28-29210bc6b40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f7f446-e474-4ff1-ad17-0c97da936e8c', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:18 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd18bb0-fd18-48f9-88d0-1f01efb36e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:19 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume volume-64f7f446-e474-4ff1-ad17-0c97da936e8c (64f7f446-e474-4ff1-ad17-0c97da936e8c): created successfully Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd18bb0-fd18-48f9-88d0-1f01efb36e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (9762d3b6-2c0c-4bc0-916b-e9981b5bbf6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (91198b81-9771-4c90-ada5-84fed25e733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddc5187-5da5-4e0f-8c54-fd248e09541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddc5187-5da5-4e0f-8c54-fd248e09541b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1307089424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc92777-7ea1-4495-9163-237578965cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:18Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9310227-eef6-49fb-91a5-5cf71cce364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9310227-eef6-49fb-91a5-5cf71cce364e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b54ba1-c43c-4585-a88b-9cebe80557b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b54ba1-c43c-4585-a88b-9cebe80557b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc92777-7ea1-4495-9163-237578965cef', 'volume_name': 'volume-cbc92777-7ea1-4495-9163-237578965cef', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7cc9ea-0a6c-4e85-bc29-64ac9e185adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7cc9ea-0a6c-4e85-bc29-64ac9e185adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ac397d-5db8-4c8b-abf7-ed3788796f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:19 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume cbc92777-7ea1-4495-9163-237578965cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc92777-7ea1-4495-9163-237578965cef', 'volume_size': 1} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:19 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-3efbf5af-c15f-4bde-83eb-129585e4c5d6 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created volume successfully. Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-da8fb1ff-fef7-4691-972c-7c15bada6725 1073741824" returned: 0 in 0.760s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-da8fb1ff-fef7-4691-972c-7c15bada6725 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (7eb0e960-116c-4a73-9ca6-2daead199404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0fa328-126d-4b9f-a809-19991cd532ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (c736f586-fd83-415b-a615-80ebc9c3f1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d464651c-eacd-487d-bac3-8d4f57af5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0fa328-126d-4b9f-a809-19991cd532ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989996545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7b697c-0542-4175-9cae-8f5f6e7c6bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:19Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98238c07-0f4a-42a5-a5ad-a7d0dd2e374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98238c07-0f4a-42a5-a5ad-a7d0dd2e374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac1bb1c-c484-4619-aedc-684925c4dd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac1bb1c-c484-4619-aedc-684925c4dd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7b697c-0542-4175-9cae-8f5f6e7c6bc5', 'volume_name': 'volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3938f70a-ce80-485a-a786-4cfd42fa1164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3938f70a-ce80-485a-a786-4cfd42fa1164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52b4b9b-42ce-474f-a4c0-e11c3f96ebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume 1d7b697c-0542-4175-9cae-8f5f6e7c6bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5', 'volume_size': 1} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-da8fb1ff-fef7-4691-972c-7c15bada6725" returned: 0 in 0.731s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d464651c-eacd-487d-bac3-8d4f57af5846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493382508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077506d4-31a2-457a-9f17-89a4b0cebc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:19Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9dc8ca-bef3-4e08-bc1a-155e0bf9caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9dc8ca-bef3-4e08-bc1a-155e0bf9caf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504807e4-d999-4426-870f-63b39f73b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504807e4-d999-4426-870f-63b39f73b11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '077506d4-31a2-457a-9f17-89a4b0cebc37', 'volume_name': 'volume-077506d4-31a2-457a-9f17-89a4b0cebc37', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f132f94-ce1d-498b-8a32-72a839f2cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f132f94-ce1d-498b-8a32-72a839f2cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20704f8f-6335-4e24-826a-d24de9fe1408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume 077506d4-31a2-457a-9f17-89a4b0cebc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-077506d4-31a2-457a-9f17-89a4b0cebc37', 'volume_size': 1} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] <== create_volume: return (1554ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1307089424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc92777-7ea1-4495-9163-237578965cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:18Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Creating volume cbc92777-7ea1-4495-9163-237578965cef {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:06:20 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cbc92777-7ea1-4495-9163-237578965cef 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:20 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=142, name=volume-cbc92777-7ea1-4495-9163-237578965cef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef025adf-1cc0-427e-b3f1-9e8fe2073f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8fb1ff-fef7-4691-972c-7c15bada6725', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebdf990-2f1b-4cda-a381-454a7e770629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:20 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume volume-da8fb1ff-fef7-4691-972c-7c15bada6725 (da8fb1ff-fef7-4691-972c-7c15bada6725): created successfully Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebdf990-2f1b-4cda-a381-454a7e770629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (f149f9b3-cb9a-4a56-b04d-03c68db0eeec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cbc92777-7ea1-4495-9163-237578965cef 1073741824" returned: 0 in 0.443s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cbc92777-7ea1-4495-9163-237578965cef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cbc92777-7ea1-4495-9163-237578965cef" returned: 0 in 0.136s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] <== create_volume: return (621ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.634s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989996545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7b697c-0542-4175-9cae-8f5f6e7c6bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:19Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Creating volume 1d7b697c-0542-4175-9cae-8f5f6e7c6bc5 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:06:20 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:06:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:21 devstack quobyte-client[82625]: System call of process 100724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:06:21 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=143, name=volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-cc43082c-4867-4702-b5ad-f92cdac2131f tempest-CreateVolumesFromSnapshotTest-503331301 None] Created volume successfully. Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ac397d-5db8-4c8b-abf7-ed3788796f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc92777-7ea1-4495-9163-237578965cef', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a48c6c-e5ff-4357-8b70-f82543fc05f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:21 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume volume-cbc92777-7ea1-4495-9163-237578965cef (cbc92777-7ea1-4495-9163-237578965cef): created successfully Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a48c6c-e5ff-4357-8b70-f82543fc05f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (91198b81-9771-4c90-ada5-84fed25e733d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5 1073741824" returned: 0 in 0.501s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-af4ff18e-51c7-45af-a24b-b29d92f623f9 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created volume successfully. Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5" returned: 0 in 0.272s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] <== create_volume: return (800ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.603s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493382508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077506d4-31a2-457a-9f17-89a4b0cebc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be58d89fd224053a6699e46dfe2487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:19Z,use_quota=True,user_id='c97f3b5c18bc4bf99c6192db27298c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Creating volume 077506d4-31a2-457a-9f17-89a4b0cebc37 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:06:21 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:06:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-077506d4-31a2-457a-9f17-89a4b0cebc37 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:21 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=144, name=volume-077506d4-31a2-457a-9f17-89a4b0cebc37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:21 devstack quobyte-client[82625]: System call of process 100728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-077506d4-31a2-457a-9f17-89a4b0cebc37 1073741824" returned: 0 in 0.318s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-077506d4-31a2-457a-9f17-89a4b0cebc37 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-077506d4-31a2-457a-9f17-89a4b0cebc37" returned: 0 in 0.088s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] <== create_volume: return (481ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.504s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52b4b9b-42ce-474f-a4c0-e11c3f96ebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda9d8eb-f355-46a4-8c11-46dd5fb20836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20704f8f-6335-4e24-826a-d24de9fe1408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077506d4-31a2-457a-9f17-89a4b0cebc37', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15624e9d-7f02-4462-9bdd-2ec38c9cb81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:22 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5 (1d7b697c-0542-4175-9cae-8f5f6e7c6bc5): created successfully Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda9d8eb-f355-46a4-8c11-46dd5fb20836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (7eb0e960-116c-4a73-9ca6-2daead199404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:22 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume volume-077506d4-31a2-457a-9f17-89a4b0cebc37 (077506d4-31a2-457a-9f17-89a4b0cebc37): created successfully Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15624e9d-7f02-4462-9bdd-2ec38c9cb81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Flow 'volume_create_manager' (c736f586-fd83-415b-a615-80ebc9c3f1bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-038f07ca-abe7-4840-8ef8-9f09988d12e2 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created volume successfully. Sep 10 18:06:22 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1ce8115c-c3ec-43b4-84c6-125d39f7165a tempest-CreateVolumesFromSnapshotTest-503331301 None] Created volume successfully. Sep 10 18:06:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-quobyte-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5" acquired by "delete_volume" :: waited 0.019s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:24 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[d299575c-c9b9-4327-b5e3-6b3739374e9d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5" returned: 0 in 0.489s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5" returned: 0 in 0.140s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5" released by "delete_volume" :: held 0.870s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created reservations ['7e06aaf3-0bdc-4647-8f37-bcc4ba4c90ff', 'b6680e2f-5cc4-47e0-bb54-781bcc0e2f32', 'cd28fa99-7975-4af7-a7bc-8c48d0dbe442', 'd08c97fe-fe57-4872-9f52-63bb2640a057'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.090s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:26 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:06:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Deleted volume successfully. Sep 10 18:06:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-c14e3a04-f183-4ff3-b5c2-83e51d46d676 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-1d7b697c-0542-4175-9cae-8f5f6e7c6bc5-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-077506d4-31a2-457a-9f17-89a4b0cebc37-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-077506d4-31a2-457a-9f17-89a4b0cebc37-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:26 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-quobyte-077506d4-31a2-457a-9f17-89a4b0cebc37" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:26 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-077506d4-31a2-457a-9f17-89a4b0cebc37" acquired by "delete_volume" :: waited 0.014s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:26 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3177e79a-e835-4d65-a75d-a203d36ae192]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-077506d4-31a2-457a-9f17-89a4b0cebc37 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-077506d4-31a2-457a-9f17-89a4b0cebc37" returned: 0 in 0.466s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-077506d4-31a2-457a-9f17-89a4b0cebc37 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-077506d4-31a2-457a-9f17-89a4b0cebc37" returned: 0 in 0.088s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-077506d4-31a2-457a-9f17-89a4b0cebc37" released by "delete_volume" :: held 0.716s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.272s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created reservations ['19a293a8-8ae6-46a0-87b2-acb865b7d250', 'b4109d04-511e-46c1-82c4-594312815ea7', 'eed6402b-ec32-47c4-8714-354db8d78526', 'efeb6339-7082-4a39-8cc7-5fa5ce28beda'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.087s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:06:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Deleted volume successfully. Sep 10 18:06:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-adb22f2d-0db3-415f-96c2-98326c564cf8 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-077506d4-31a2-457a-9f17-89a4b0cebc37-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-cbc92777-7ea1-4495-9163-237578965cef-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-cbc92777-7ea1-4495-9163-237578965cef-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:29 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-quobyte-cbc92777-7ea1-4495-9163-237578965cef" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-cbc92777-7ea1-4495-9163-237578965cef" acquired by "delete_volume" :: waited 0.014s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[61033e45-65c2-4c5b-a17a-d63a12512138]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cbc92777-7ea1-4495-9163-237578965cef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cbc92777-7ea1-4495-9163-237578965cef" returned: 0 in 0.398s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cbc92777-7ea1-4495-9163-237578965cef {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-cbc92777-7ea1-4495-9163-237578965cef" returned: 0 in 0.087s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-cbc92777-7ea1-4495-9163-237578965cef" released by "delete_volume" :: held 0.636s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created reservations ['5f18f1f5-b111-4a1a-aa2b-028761a8a1d6', 'b64c6e8d-d331-42c2-9f6d-351f1a05bd65', '1a015e52-4252-47de-aff0-7af63d2483f1', '584fc19d-09fc-4a19-bde4-b6cadadcaa13'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.081s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:06:30 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Deleted volume successfully. Sep 10 18:06:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-038ae94a-e9dd-4258-a5dd-adb11ac2a3d4 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-cbc92777-7ea1-4495-9163-237578965cef-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-da8fb1ff-fef7-4691-972c-7c15bada6725-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-da8fb1ff-fef7-4691-972c-7c15bada6725-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:31 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-quobyte-da8fb1ff-fef7-4691-972c-7c15bada6725" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-da8fb1ff-fef7-4691-972c-7c15bada6725" acquired by "delete_volume" :: waited 0.023s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:31 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da37016-3514-42e9-aba0-387da704ff3d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-da8fb1ff-fef7-4691-972c-7c15bada6725 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-da8fb1ff-fef7-4691-972c-7c15bada6725" returned: 0 in 0.396s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-da8fb1ff-fef7-4691-972c-7c15bada6725 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-da8fb1ff-fef7-4691-972c-7c15bada6725" returned: 0 in 0.086s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-da8fb1ff-fef7-4691-972c-7c15bada6725" released by "delete_volume" :: held 0.629s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created reservations ['71fe7aea-d299-42a2-857b-d2621c6fcb6d', '3c21ae46-6eaf-4e36-916d-0ba327c0fab0', '98865062-35fe-483c-ba16-fb8282581a01', '9cf681cf-036e-4ae6-b5ba-8592274fc232'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.096s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:32 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:06:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Deleted volume successfully. Sep 10 18:06:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d4b08ec7-8bbc-44f0-a6ac-3e987e58e919 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-da8fb1ff-fef7-4691-972c-7c15bada6725-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-64f7f446-e474-4ff1-ad17-0c97da936e8c-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-64f7f446-e474-4ff1-ad17-0c97da936e8c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:33 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-quobyte-64f7f446-e474-4ff1-ad17-0c97da936e8c" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-64f7f446-e474-4ff1-ad17-0c97da936e8c" acquired by "delete_volume" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:33 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed46af7d-6d72-4f50-8f71-3abf2cc5bc3b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-64f7f446-e474-4ff1-ad17-0c97da936e8c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-64f7f446-e474-4ff1-ad17-0c97da936e8c" returned: 0 in 0.444s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-64f7f446-e474-4ff1-ad17-0c97da936e8c {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-64f7f446-e474-4ff1-ad17-0c97da936e8c" returned: 0 in 0.083s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-64f7f446-e474-4ff1-ad17-0c97da936e8c" released by "delete_volume" :: held 0.678s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:34 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Created reservations ['813f86a3-d9f5-4ff0-b676-fb2a1da0fc48', '4bfd1ca6-25e7-4f7c-96b0-620d0d973841', 'd267aa5b-c2d9-4d3a-a82a-935e80d11715', '555ee71a-26d8-4ef2-8b18-78f6d706688b'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.089s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:06:35 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Deleted volume successfully. Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-87352077-0794-4406-9f02-c3a1532f67d0 tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-64f7f446-e474-4ff1-ad17-0c97da936e8c-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-0525ef57-f137-4b27-9407-dc7951b30c64-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-0525ef57-f137-4b27-9407-dc7951b30c64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-quobyte-c8ff84f3-ae2b-4304-ab60-7a2baf936265" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-c8ff84f3-ae2b-4304-ab60-7a2baf936265" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-quobyte-0525ef57-f137-4b27-9407-dc7951b30c64" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-0525ef57-f137-4b27-9407-dc7951b30c64" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Deleting offline snapshot 0525ef57-f137-4b27-9407-dc7951b30c64 of volume c8ff84f3-ae2b-4304-ab60-7a2baf936265 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] snapshot_file for this snap is: volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84d6c70-236b-4eb3-8ff0-d9da208b332e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64" returned: 0 in 0.364s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0391c9-639d-4b77-bf5b-fe4c95bff075]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265" returned: 0 in 0.384s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64" returned: 0 in 0.251s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265.0525ef57-f137-4b27-9407-dc7951b30c64" returned: 0 in 0.085s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-0525ef57-f137-4b27-9407-dc7951b30c64" released by "_delete_snapshot" :: held 1.374s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-c8ff84f3-ae2b-4304-ab60-7a2baf936265" released by "delete_snapshot" :: held 1.400s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:37 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Created reservations ['cdffdc9c-598f-40d7-ad98-e3418382ac12', '695d5cdb-5dbb-4908-ba8d-0ceeff4cb561', '29faf747-fdff-4141-8c99-13396e77f6b5', '1012bd4d-c188-40d2-bade-121df97bc430'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:06:37 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Delete snapshot completed successfully. Sep 10 18:06:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-021874c8-9616-4445-a2a8-acca3fc05cbf tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-0525ef57-f137-4b27-9407-dc7951b30c64-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-c8ff84f3-ae2b-4304-ab60-7a2baf936265-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-c8ff84f3-ae2b-4304-ab60-7a2baf936265-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:38 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "cinder-quobyte-c8ff84f3-ae2b-4304-ab60-7a2baf936265" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-c8ff84f3-ae2b-4304-ab60-7a2baf936265" acquired by "delete_volume" :: waited 0.010s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7952ef-6ecf-4b11-ae34-e0615cedd0e9]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265" returned: 0 in 0.389s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8ff84f3-ae2b-4304-ab60-7a2baf936265" returned: 0 in 0.110s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-quobyte-c8ff84f3-ae2b-4304-ab60-7a2baf936265" released by "delete_volume" :: held 0.658s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Created reservations ['b09dc7a8-c71a-4d2a-acb6-16afb5ae751f', '23307014-084f-464a-b88a-50c23da6eee6', '2fba1f18-f0f2-4f0f-9e5c-95788a1e8c4d', '8f3f49d1-8968-49b8-b7e4-3a62254f0237'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.134s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:06:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Deleted volume successfully. Sep 10 18:06:39 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-af404b71-5e87-47d5-a8f4-b9c8ea3a38ec tempest-CreateVolumesFromSnapshotTest-503331301 None] Lock "cinder-c8ff84f3-ae2b-4304-ab60-7a2baf936265-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:44 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Flow 'volume_create_manager' (ff29b1c0-573e-4842-887f-5deeb43ae798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ac5dc4-f481-4d8f-9b0b-9c8da292a7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ac5dc4-f481-4d8f-9b0b-9c8da292a7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc8ff7d-92f5-47f6-b85a-e95664a9dd24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9eb510c01d4963b99cd67e2e5616e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:44Z,use_quota=True,user_id='ff67c283b55e443787f3a5eb9a162fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb97abed-da65-49b1-9602-64139a62e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb97abed-da65-49b1-9602-64139a62e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aadb7d3-45a0-43ec-a7cf-195928fa210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aadb7d3-45a0-43ec-a7cf-195928fa210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7cc8ff7d-92f5-47f6-b85a-e95664a9dd24', 'volume_name': 'volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24', 'volume_size': 1, 'image_id': 'aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ff9e21b7f3212120d4513937a4e8c20', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9eb510c01d4963b99cd67e2e5616e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '328d9ff4de4a200449ecdbc67e2b54fed482c2911feff622e18fd65d0a96766ba10b27f25f1e589a06431d645de097f2d309cbebac0abeb1ae1d4f6d244b81c2', 'id': 'aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5', 'created_at': datetime.datetime(2025, 9, 10, 16, 6, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5/file', 'properties': {}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7a8de3-d944-486d-a4bd-0e2f31ee4689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7a8de3-d944-486d-a4bd-0e2f31ee4689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f6cd48-f6f3-4cdd-a760-8060db879067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:44 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Volume 7cc8ff7d-92f5-47f6-b85a-e95664a9dd24: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24', 'volume_size': 1, 'image_id': 'aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ff9e21b7f3212120d4513937a4e8c20', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9eb510c01d4963b99cd67e2e5616e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '328d9ff4de4a200449ecdbc67e2b54fed482c2911feff622e18fd65d0a96766ba10b27f25f1e589a06431d645de097f2d309cbebac0abeb1ae1d4f6d244b81c2', 'id': 'aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5', 'created_at': datetime.datetime(2025, 9, 10, 16, 6, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5/file', 'properties': {}}, 'image_service': } Sep 10 18:06:44 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Cloning 7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 from image aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5 at location (None, None). {{(pid=82609) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 18:06:45 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 18:06:45 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Image download 0.00 MB at 0.00 MB/s Sep 10 18:06:45 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89d7426-5f6e-4490-af46-2b455da654e3]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:45 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD Sep 10 18:06:45 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:06:47 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 10 18:06:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD" returned: 0 in 1.974s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:47 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD Sep 10 18:06:47 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:06:49 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 10 18:06:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD" returned: 1 in 1.998s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:06:49 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Temporary image aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5 is fetched for user ff67c283b55e443787f3a5eb9a162fd5. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 18:06:49 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebcedfd-6a1e-4bc5-9971-75c6074b6d97]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:49 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD Sep 10 18:06:49 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:06:51 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 10 18:06:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD" returned: 0 in 1.951s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:51 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD Sep 10 18:06:51 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:06:53 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD" returned: 1 in 1.890s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc8ff7d-92f5-47f6-b85a-e95664a9dd24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9eb510c01d4963b99cd67e2e5616e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:06:44Z,use_quota=True,user_id='ff67c283b55e443787f3a5eb9a162fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Creating volume 7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:06:53 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:53 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=145, name=volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 1073741824" returned: 0 in 0.283s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" returned: 0 in 0.083s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] <== create_volume: return (458ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:06:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Attempting download of aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5 ((None, None)) to volume 7cc8ff7d-92f5-47f6-b85a-e95664a9dd24. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b56e2fa-d2e3-4b9c-b6aa-5818b399c4b3]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5__77ajai5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5__77ajai5" returned: 0 in 0.331s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5__77ajai5 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5__77ajai5" returned: 1 in 0.348s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5__77ajai5' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e79232-5c73-414f-b9ce-b3ebf83c490a]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5 was raw, converting to raw {{(pid=82609) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:55 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=145, name=volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" returned: 0 in 0.143s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5_r6_yt_vhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 18:06:55 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 18:06:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 1G" returned: 0 in 0.121s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3f195-9885-4843-9c45-181dfb7ad2ae]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" returned: 0 in 0.348s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" returned: 1 in 0.348s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Downloaded image aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5 ((None, None)) to volume 7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 successfully. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Temporary image aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5 for user ff67c283b55e443787f3a5eb9a162fd5 is deleted. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 18:06:56 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Marking volume 7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 as bootable. {{(pid=82609) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Copying metadata from image aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5 to 7cc8ff7d-92f5-47f6-b85a-e95664a9dd24. {{(pid=82609) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Creating volume glance metadata for volume 7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 backed by image aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5 with: {'image_id': 'aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3ff9e21b7f3212120d4513937a4e8c20', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82609) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f6cd48-f6f3-4cdd-a760-8060db879067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24', 'volume_size': 1, 'image_id': 'aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ff9e21b7f3212120d4513937a4e8c20', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9eb510c01d4963b99cd67e2e5616e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '328d9ff4de4a200449ecdbc67e2b54fed482c2911feff622e18fd65d0a96766ba10b27f25f1e589a06431d645de097f2d309cbebac0abeb1ae1d4f6d244b81c2', 'id': 'aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5', 'created_at': datetime.datetime(2025, 9, 10, 16, 6, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aba7cae7-d45f-47d3-b0a2-2a3dfb5972f5/file', 'properties': {}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef3f601-7da2-4f01-baea-8c4f2c7ce0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:06:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Volume volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 (7cc8ff7d-92f5-47f6-b85a-e95664a9dd24): created successfully Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef3f601-7da2-4f01-baea-8c4f2c7ce0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Flow 'volume_create_manager' (ff29b1c0-573e-4842-887f-5deeb43ae798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:06:57 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-c00378fb-4980-4722-95b5-fc1c7a9862ab tempest-VolumeImageDependencyTests-129184021 None] Created volume successfully. Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Acquiring lock "cinder-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Lock "cinder-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:06:57 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Acquiring lock "cinder-quobyte-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Lock "cinder-quobyte-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" acquired by "delete_volume" :: waited 0.011s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a71de4e-9c10-4139-9a7e-b70c396dee76]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" returned: 0 in 0.356s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" returned: 1 in 0.364s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" returned: 0 in 0.079s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Lock "cinder-quobyte-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24" released by "delete_volume" :: held 1.051s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Created reservations ['38ae076d-ee25-474f-971f-380541d287b6', '4f48120e-e2ba-482c-a13c-f8d559999d90', 'f33c3fd6-760e-47e9-bf69-22aa99c0e875', 'd13413e8-6b00-45d1-86b8-ae5db680c134'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.086s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:06:59 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Deleted volume successfully. Sep 10 18:06:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-54d09953-c4f8-4422-984e-bbe639e5e9ea tempest-VolumeImageDependencyTests-129184021 None] Lock "cinder-7cc8ff7d-92f5-47f6-b85a-e95664a9dd24-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:09 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=77,cinder:SELECT=58,cinder:DELETE=6,cinder:INSERT=22 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:07:09 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=49,cinder:UPDATE=79,cinder:DELETE=9,cinder:INSERT=19 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:07:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (3185756d-d9ec-4525-b528-006c7cb1d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8e878a-4e4d-426c-91d6-7da19860e479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8e878a-4e4d-426c-91d6-7da19860e479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783068100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8aff7f6-11b6-4a32-9773-88947674aa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:19Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46c3a78-8541-4167-b147-c9b885dc5417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46c3a78-8541-4167-b147-c9b885dc5417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f219c4-3e10-4eeb-bb2e-8f9d177cefee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f219c4-3e10-4eeb-bb2e-8f9d177cefee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8aff7f6-11b6-4a32-9773-88947674aa53', 'volume_name': 'volume-c8aff7f6-11b6-4a32-9773-88947674aa53', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25acbf06-fe25-468f-b242-d34fb1bba200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25acbf06-fe25-468f-b242-d34fb1bba200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53415e3d-153a-4cf6-b17d-39416560f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:19 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Volume c8aff7f6-11b6-4a32-9773-88947674aa53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8aff7f6-11b6-4a32-9773-88947674aa53', 'volume_size': 1} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783068100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8aff7f6-11b6-4a32-9773-88947674aa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:19Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Creating volume c8aff7f6-11b6-4a32-9773-88947674aa53 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:19 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8aff7f6-11b6-4a32-9773-88947674aa53 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:19 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:19 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=146, name=volume-c8aff7f6-11b6-4a32-9773-88947674aa53, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:19 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (6a783ad8-0d3a-4a8d-bd5f-9ff30240b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfbe415-3652-4f25-a4b5-4b50a6333efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfbe415-3652-4f25-a4b5-4b50a6333efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706437121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea293a0-d184-496a-b838-ccded703ee41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:19Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db11dd43-8b25-4841-9818-a8e985a74197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db11dd43-8b25-4841-9818-a8e985a74197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3761f6b6-551b-46b8-8582-42235ff4d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3761f6b6-551b-46b8-8582-42235ff4d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea293a0-d184-496a-b838-ccded703ee41', 'volume_name': 'volume-6ea293a0-d184-496a-b838-ccded703ee41', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0593a0b9-919c-43e4-b0b5-3467ec129c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0593a0b9-919c-43e4-b0b5-3467ec129c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9535f6c4-79d8-49b6-9061-018b50173877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:20 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume 6ea293a0-d184-496a-b838-ccded703ee41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea293a0-d184-496a-b838-ccded703ee41', 'volume_size': 1} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8aff7f6-11b6-4a32-9773-88947674aa53 1073741824" returned: 0 in 1.304s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8aff7f6-11b6-4a32-9773-88947674aa53 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (e97353f1-10c6-4430-b9b2-6572163a3704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fb959b-b611-4100-938f-3f33a764e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (4e886ef3-b1ed-4ad0-99f7-b806c432b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ba5f58-aa22-4bda-8de0-99943530ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8aff7f6-11b6-4a32-9773-88947674aa53" returned: 0 in 0.809s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fb959b-b611-4100-938f-3f33a764e4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1746426737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d406016-08ef-4e86-83f1-08dab6579647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:20Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70feaad5-eea9-45d3-ae05-04bb370049eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70feaad5-eea9-45d3-ae05-04bb370049eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba88690d-1a8a-48fd-baf1-0bc77bdf93fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba88690d-1a8a-48fd-baf1-0bc77bdf93fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d406016-08ef-4e86-83f1-08dab6579647', 'volume_name': 'volume-6d406016-08ef-4e86-83f1-08dab6579647', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a437f9ce-706f-4c31-8255-8f8a3a55f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a437f9ce-706f-4c31-8255-8f8a3a55f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae971f83-d096-4a1d-a4f3-f0b2f86da968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:21 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Volume 6d406016-08ef-4e86-83f1-08dab6579647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d406016-08ef-4e86-83f1-08dab6579647', 'volume_size': 1} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] <== create_volume: return (2193ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706437121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea293a0-d184-496a-b838-ccded703ee41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:19Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Creating volume 6ea293a0-d184-496a-b838-ccded703ee41 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:21 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:21 devstack quobyte-client[82625]: System call of process 100925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:21 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=147, name=volume-6ea293a0-d184-496a-b838-ccded703ee41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ba5f58-aa22-4bda-8de0-99943530ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-815398066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62dd334-79e2-4ac8-82ce-3d19a067ed3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:20Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cc8d02-c954-4826-986f-3b2daf42369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cc8d02-c954-4826-986f-3b2daf42369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c26bfbe-9473-40c2-9fb9-af08b5a3ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c26bfbe-9473-40c2-9fb9-af08b5a3ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62dd334-79e2-4ac8-82ce-3d19a067ed3e', 'volume_name': 'volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcb81b8-4ad2-4ab2-9cad-de394d0aafad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcb81b8-4ad2-4ab2-9cad-de394d0aafad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2ee2b3-a295-42d0-89d2-800d2db21d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:22 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Volume b62dd334-79e2-4ac8-82ce-3d19a067ed3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e', 'volume_size': 1} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53415e3d-153a-4cf6-b17d-39416560f069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8aff7f6-11b6-4a32-9773-88947674aa53', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db73201f-6901-4caf-8003-bcec271a8ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:22 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (2e6f1a60-0e8a-43cb-bdd1-ec71ba9d4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c0c62b-8797-4f11-b205-17b9fc7f669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 1073741824" returned: 0 in 0.680s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:22 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Volume volume-c8aff7f6-11b6-4a32-9773-88947674aa53 (c8aff7f6-11b6-4a32-9773-88947674aa53): created successfully Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db73201f-6901-4caf-8003-bcec271a8ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (3185756d-d9ec-4525-b528-006c7cb1d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:22 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:22 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (c2b7086e-5ac8-44d5-a5e6-b462cc044dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf064ca-5771-472e-9c26-470d4c95601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c0c62b-8797-4f11-b205-17b9fc7f669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868950487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e3931b-f4d2-4f36-8013-8f94dead458f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:21Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80e10d4-6645-4a1a-bd3b-22050b4e002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80e10d4-6645-4a1a-bd3b-22050b4e002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774bbd0-12b8-48f6-91b0-77bbac473121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774bbd0-12b8-48f6-91b0-77bbac473121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e3931b-f4d2-4f36-8013-8f94dead458f', 'volume_name': 'volume-96e3931b-f4d2-4f36-8013-8f94dead458f', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11e02df-b7b2-4e28-b50a-74a1ae0e27fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11e02df-b7b2-4e28-b50a-74a1ae0e27fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30290ba0-d6bb-483b-8bf7-0a301ff2cc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Volume 96e3931b-f4d2-4f36-8013-8f94dead458f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e3931b-f4d2-4f36-8013-8f94dead458f', 'volume_size': 1} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41" returned: 0 in 0.640s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] <== create_volume: return (1342ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1746426737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d406016-08ef-4e86-83f1-08dab6579647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:20Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Creating volume 6d406016-08ef-4e86-83f1-08dab6579647 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:23 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6d406016-08ef-4e86-83f1-08dab6579647 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:23 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=148, name=volume-6d406016-08ef-4e86-83f1-08dab6579647, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:23 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1c32155e-85bf-4b56-91a7-9836688eb9c5 tempest-CreateVolumesFromImageTest-1431517176 None] Created volume successfully. Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf064ca-5771-472e-9c26-470d4c95601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1075659527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db9d48f-aa4c-422d-b455-97213d62ce84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:21Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc5c0da-0809-42d0-ba5f-7f38bb754089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc5c0da-0809-42d0-ba5f-7f38bb754089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd0195-c2cf-49e7-a3e2-e8b44a08e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd0195-c2cf-49e7-a3e2-e8b44a08e443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db9d48f-aa4c-422d-b455-97213d62ce84', 'volume_name': 'volume-7db9d48f-aa4c-422d-b455-97213d62ce84', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6819ed6-3e5e-4415-8ec4-41ac781acd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6819ed6-3e5e-4415-8ec4-41ac781acd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875f8cad-a931-4986-bc8a-5368abca0b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Volume 7db9d48f-aa4c-422d-b455-97213d62ce84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db9d48f-aa4c-422d-b455-97213d62ce84', 'volume_size': 1} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9535f6c4-79d8-49b6-9061-018b50173877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea293a0-d184-496a-b838-ccded703ee41', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08357e34-a305-4736-8f11-b8bef0ab4762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6d406016-08ef-4e86-83f1-08dab6579647 1073741824" returned: 0 in 0.614s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6d406016-08ef-4e86-83f1-08dab6579647 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:23 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume volume-6ea293a0-d184-496a-b838-ccded703ee41 (6ea293a0-d184-496a-b838-ccded703ee41): created successfully Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08357e34-a305-4736-8f11-b8bef0ab4762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (6a783ad8-0d3a-4a8d-bd5f-9ff30240b770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-e456aa2f-0ef9-4229-8225-6dfc11ef6af1 tempest-CreateVolumesFromSnapshotTest-970769676 None] Created volume successfully. Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6d406016-08ef-4e86-83f1-08dab6579647" returned: 0 in 0.429s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] <== create_volume: return (1067ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-815398066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62dd334-79e2-4ac8-82ce-3d19a067ed3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:20Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Creating volume b62dd334-79e2-4ac8-82ce-3d19a067ed3e {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:24 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:24 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=149, name=volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae971f83-d096-4a1d-a4f3-f0b2f86da968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d406016-08ef-4e86-83f1-08dab6579647', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444911b2-2f4e-4202-bb21-b4306ef15aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e 1073741824" returned: 0 in 0.550s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:25 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Volume volume-6d406016-08ef-4e86-83f1-08dab6579647 (6d406016-08ef-4e86-83f1-08dab6579647): created successfully Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444911b2-2f4e-4202-bb21-b4306ef15aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (e97353f1-10c6-4430-b9b2-6572163a3704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:25 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-543bfae4-add6-423c-8c19-c12977641fe8 tempest-CreateVolumesFromImageTest-1431517176 None] Created volume successfully. Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e" returned: 0 in 0.619s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] <== create_volume: return (1214ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.437s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868950487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e3931b-f4d2-4f36-8013-8f94dead458f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:21Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Creating volume 96e3931b-f4d2-4f36-8013-8f94dead458f {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:25 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-96e3931b-f4d2-4f36-8013-8f94dead458f 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:25 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=150, name=volume-96e3931b-f4d2-4f36-8013-8f94dead458f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:25 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2ee2b3-a295-42d0-89d2-800d2db21d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba764ab-de7b-4471-94ce-7f81bbf942ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-96e3931b-f4d2-4f36-8013-8f94dead458f 1073741824" returned: 0 in 0.579s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-96e3931b-f4d2-4f36-8013-8f94dead458f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:26 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Volume volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e (b62dd334-79e2-4ac8-82ce-3d19a067ed3e): created successfully Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba764ab-de7b-4471-94ce-7f81bbf942ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (4e886ef3-b1ed-4ad0-99f7-b806c432b474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:26 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-5113c413-bf83-4122-ad0c-f5b68564244c tempest-CreateVolumesFromImageTest-1431517176 None] Created volume successfully. Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-96e3931b-f4d2-4f36-8013-8f94dead458f" returned: 0 in 0.420s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] <== create_volume: return (1030ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.905s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1075659527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db9d48f-aa4c-422d-b455-97213d62ce84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd223428694281b45e3aa839ae5cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:21Z,use_quota=True,user_id='d3364feb356d45dabb4894d5e6bf4183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Creating volume 7db9d48f-aa4c-422d-b455-97213d62ce84 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:26 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7db9d48f-aa4c-422d-b455-97213d62ce84 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:26 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=151, name=volume-7db9d48f-aa4c-422d-b455-97213d62ce84, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30290ba0-d6bb-483b-8bf7-0a301ff2cc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e3931b-f4d2-4f36-8013-8f94dead458f', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b4fb5f-6f88-4fb1-abba-2b3d41b7ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:27 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Volume volume-96e3931b-f4d2-4f36-8013-8f94dead458f (96e3931b-f4d2-4f36-8013-8f94dead458f): created successfully Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b4fb5f-6f88-4fb1-abba-2b3d41b7ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (2e6f1a60-0e8a-43cb-bdd1-ec71ba9d4b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:27 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2a0adbb0-8538-4561-959e-b98d0081d51a tempest-CreateVolumesFromImageTest-1431517176 None] Created volume successfully. Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7db9d48f-aa4c-422d-b455-97213d62ce84 1073741824" returned: 0 in 0.656s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7db9d48f-aa4c-422d-b455-97213d62ce84 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7db9d48f-aa4c-422d-b455-97213d62ce84" returned: 0 in 0.380s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] <== create_volume: return (1104ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.918s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875f8cad-a931-4986-bc8a-5368abca0b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db9d48f-aa4c-422d-b455-97213d62ce84', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de42367b-1f3a-4e24-9be7-99408830b165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Creating offline snapshot 53eefe13-0324-4c2c-86fa-5dfed6398886 of volume 6ea293a0-d184-496a-b838-ccded703ee41 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 18:07:28 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Volume volume-7db9d48f-aa4c-422d-b455-97213d62ce84 (7db9d48f-aa4c-422d-b455-97213d62ce84): created successfully Sep 10 18:07:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de42367b-1f3a-4e24-9be7-99408830b165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Flow 'volume_create_manager' (c2b7086e-5ac8-44d5-a5e6-b462cc044dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:28 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a91277d-83fd-4361-8e8e-49c7413f8147]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:28 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-754541a3-bcd8-4ce6-94f2-2e3b8b73a18b tempest-CreateVolumesFromImageTest-1431517176 None] Created volume successfully. Sep 10 18:07:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 1.210s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:29 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-7db9d48f-aa4c-422d-b455-97213d62ce84-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-7db9d48f-aa4c-422d-b455-97213d62ce84-delete_volume" acquired by "delete_volume" :: waited 0.180s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41" returned: 0 in 0.972s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:29 devstack quobyte-client[82625]: System call of process 100951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:29 devstack quobyte-client[82625]: System call of process 100951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:30 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=152, name=volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:30 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-quobyte-7db9d48f-aa4c-422d-b455-97213d62ce84" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 1G" returned: 0 in 0.839s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6ea293a0-d184-496a-b838-ccded703ee41 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:30 devstack quobyte-client[82625]: System call of process 100954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:30 devstack quobyte-client[82625]: System call of process 100954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:30 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-7db9d48f-aa4c-422d-b455-97213d62ce84" acquired by "delete_volume" :: waited 0.270s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:30 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f33aff-e13f-46a0-8aa1-14bf78d36138]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7db9d48f-aa4c-422d-b455-97213d62ce84 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img rebase -u -b volume-6ea293a0-d184-496a-b838-ccded703ee41 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886" returned: 0 in 0.417s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886" returned: 0 in 0.233s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886" returned: 0 in 0.160s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.info" returned: 0 in 0.140s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7db9d48f-aa4c-422d-b455-97213d62ce84" returned: 0 in 0.948s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7db9d48f-aa4c-422d-b455-97213d62ce84 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.info" returned: 0 in 0.208s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.147s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7db9d48f-aa4c-422d-b455-97213d62ce84" returned: 0 in 0.354s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-a9b466ea-d0b3-41a5-8e8f-3326d92e6b7e tempest-CreateVolumesFromSnapshotTest-970769676 None] Create snapshot completed successfully Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-7db9d48f-aa4c-422d-b455-97213d62ce84" released by "delete_volume" :: held 1.632s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Created reservations ['56696d66-1351-4efd-bd9f-9109ce0278d4', '4ff22763-a5ab-472b-97d6-bb931fa50902', '3373c1e8-7a9f-4313-98b3-2ae26142d191', 'fd7a0dc7-882e-4ed2-a36c-ec5f68636542'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:32 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-96e3931b-f4d2-4f36-8013-8f94dead458f-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.432s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:33 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-96e3931b-f4d2-4f36-8013-8f94dead458f-delete_volume" acquired by "delete_volume" :: waited 0.199s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:33 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Deleted volume successfully. Sep 10 18:07:33 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-quobyte-96e3931b-f4d2-4f36-8013-8f94dead458f" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8ebd3824-8f74-4693-a694-9deb1cf1b4e6 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-7db9d48f-aa4c-422d-b455-97213d62ce84-delete_volume" released by "delete_volume" :: held 3.899s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:33 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-96e3931b-f4d2-4f36-8013-8f94dead458f" acquired by "delete_volume" :: waited 0.059s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:33 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bac1da-4816-4b8b-8539-fd6facfe009d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-96e3931b-f4d2-4f36-8013-8f94dead458f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:34 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (6839b803-30b8-46c4-bd9b-05fff80601f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3152d23e-02be-4d9b-8694-737b84eb5d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3152d23e-02be-4d9b-8694-737b84eb5d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1628560360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a794dd06-753a-4973-9eaf-f6ff41c19f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:34Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7a929a-b4e9-4343-8729-520551a15983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7a929a-b4e9-4343-8729-520551a15983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b326523-1cba-4a64-ac41-13228d26acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b326523-1cba-4a64-ac41-13228d26acf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a794dd06-753a-4973-9eaf-f6ff41c19f18', 'volume_name': 'volume-a794dd06-753a-4973-9eaf-f6ff41c19f18', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46981ea3-015f-4f1b-b83e-23ad04fa9a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46981ea3-015f-4f1b-b83e-23ad04fa9a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7607bd8-a3c1-4c90-afdc-024bc4f37084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:34 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume a794dd06-753a-4973-9eaf-f6ff41c19f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a794dd06-753a-4973-9eaf-f6ff41c19f18', 'volume_size': 1} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1628560360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a794dd06-753a-4973-9eaf-f6ff41c19f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:34Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Creating volume a794dd06-753a-4973-9eaf-f6ff41c19f18 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:34 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a794dd06-753a-4973-9eaf-f6ff41c19f18 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:34 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=154, name=volume-a794dd06-753a-4973-9eaf-f6ff41c19f18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-96e3931b-f4d2-4f36-8013-8f94dead458f" returned: 0 in 1.407s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-96e3931b-f4d2-4f36-8013-8f94dead458f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:35 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:35 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (ef6fd624-e64d-461a-9749-e8ed362fd4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:35 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3399ac5e-0d97-4cd3-ab28-e32d4ee6b247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3399ac5e-0d97-4cd3-ab28-e32d4ee6b247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656208647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5d4cf2-adf2-4959-8116-c241fd5bbc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:35Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34a1109-1db9-4bb3-ac4b-937271ddf82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34a1109-1db9-4bb3-ac4b-937271ddf82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f569f4-0cb0-47af-8f0e-ece24976955d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f569f4-0cb0-47af-8f0e-ece24976955d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5d4cf2-adf2-4959-8116-c241fd5bbc13', 'volume_name': 'volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8e4132-25a7-4caf-870f-e4737a2c4c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8e4132-25a7-4caf-870f-e4737a2c4c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9d8ce6-f9f5-47ba-9073-8e0dd79c28e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:36 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume 3a5d4cf2-adf2-4959-8116-c241fd5bbc13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13', 'volume_size': 1} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a794dd06-753a-4973-9eaf-f6ff41c19f18 1073741824" returned: 0 in 1.668s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a794dd06-753a-4973-9eaf-f6ff41c19f18 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-96e3931b-f4d2-4f36-8013-8f94dead458f" returned: 0 in 1.538s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a794dd06-753a-4973-9eaf-f6ff41c19f18" returned: 0 in 0.676s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (aee09b20-688f-4d0d-bec8-4ad2f645c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4d6d81-57da-4664-89ad-34770276209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] <== create_volume: return (2502ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.512s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (00eefeca-a3d8-4714-a675-8af07b813254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a205b05a-e8e5-4c4c-a896-22f4e2331079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-96e3931b-f4d2-4f36-8013-8f94dead458f" released by "delete_volume" :: held 3.447s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.912s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656208647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5d4cf2-adf2-4959-8116-c241fd5bbc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:35Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Creating volume 3a5d4cf2-adf2-4959-8116-c241fd5bbc13 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:36 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:37 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:37 devstack quobyte-client[82625]: System call of process 100975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:37 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=155, name=volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7607bd8-a3c1-4c90-afdc-024bc4f37084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a794dd06-753a-4973-9eaf-f6ff41c19f18', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5545873-9673-4db2-8e6a-2c220708c65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (874de036-4c2a-41ee-8deb-b198105acaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80872f8a-3870-4c56-8584-727a48d1cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume volume-a794dd06-753a-4973-9eaf-f6ff41c19f18 (a794dd06-753a-4973-9eaf-f6ff41c19f18): created successfully Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5545873-9673-4db2-8e6a-2c220708c65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (6839b803-30b8-46c4-bd9b-05fff80601f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a205b05a-e8e5-4c4c-a896-22f4e2331079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1162036147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b16dc68-47f3-4990-af6c-5e4ef1476375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:35Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38aeab2-5a91-4379-a93b-4a5196851ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38aeab2-5a91-4379-a93b-4a5196851ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4803ec-f36f-445a-ad0d-5f8e71c1a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4803ec-f36f-445a-ad0d-5f8e71c1a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b16dc68-47f3-4990-af6c-5e4ef1476375', 'volume_name': 'volume-7b16dc68-47f3-4990-af6c-5e4ef1476375', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb6dc9f-62fe-412a-a3c0-a1ff9a095fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb6dc9f-62fe-412a-a3c0-a1ff9a095fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c336b55a-489d-4d1f-bbbc-217f99783ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume 7b16dc68-47f3-4990-af6c-5e4ef1476375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b16dc68-47f3-4990-af6c-5e4ef1476375', 'volume_size': 1} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4d6d81-57da-4664-89ad-34770276209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140740149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0e5b0a-0d7e-41c0-b692-4304e7491952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:36Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d9e5a5-afcb-4d51-aeb6-6fd6d9d9cf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d9e5a5-afcb-4d51-aeb6-6fd6d9d9cf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220c0f56-725c-4721-af1b-26748b268085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220c0f56-725c-4721-af1b-26748b268085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0e5b0a-0d7e-41c0-b692-4304e7491952', 'volume_name': 'volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2278df-242c-4e17-966b-9de3a2743702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2278df-242c-4e17-966b-9de3a2743702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b26d34-a501-4b31-b514-e2cd27c37029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume 7e0e5b0a-0d7e-41c0-b692-4304e7491952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952', 'volume_size': 1} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:37 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8fc65165-8bfd-4604-a61d-6f0c9231339f tempest-CreateVolumesFromSnapshotTest-970769676 None] Created volume successfully. Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80872f8a-3870-4c56-8584-727a48d1cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1073300092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda25658-247a-4702-8299-f467338c232a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:37Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515713ec-b59f-4f90-936b-be39693e65d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515713ec-b59f-4f90-936b-be39693e65d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6016c8-48e3-40d0-9b4c-718aacc60ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6016c8-48e3-40d0-9b4c-718aacc60ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda25658-247a-4702-8299-f467338c232a', 'volume_name': 'volume-fda25658-247a-4702-8299-f467338c232a', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d322f3-f536-42b6-abe2-9c217b629312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d322f3-f536-42b6-abe2-9c217b629312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8af519d-9736-477a-b27f-1bd44e952b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:37 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume fda25658-247a-4702-8299-f467338c232a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda25658-247a-4702-8299-f467338c232a', 'volume_size': 1} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13 1073741824" returned: 0 in 0.841s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13" returned: 0 in 0.428s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] <== create_volume: return (1320ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.641s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1162036147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b16dc68-47f3-4990-af6c-5e4ef1476375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:35Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Creating volume 7b16dc68-47f3-4990-af6c-5e4ef1476375 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:38 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7b16dc68-47f3-4990-af6c-5e4ef1476375 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:38 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=156, name=volume-7b16dc68-47f3-4990-af6c-5e4ef1476375, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:38 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Created reservations ['87934c1a-0d27-4f07-a165-cd7fc4358f03', '4b647d9d-8279-4e4b-9f04-1ba2fdb51438', '92716c94-be22-4dd3-9ac0-db589455f0e4', '32fcfd22-915e-4a2e-84f9-0b065a5f3187'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9d8ce6-f9f5-47ba-9073-8e0dd79c28e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3387304-1794-4431-b8d6-ad392c50b5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:39 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13 (3a5d4cf2-adf2-4959-8116-c241fd5bbc13): created successfully Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3387304-1794-4431-b8d6-ad392c50b5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (ef6fd624-e64d-461a-9749-e8ed362fd4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7b16dc68-47f3-4990-af6c-5e4ef1476375 1073741824" returned: 0 in 0.921s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7b16dc68-47f3-4990-af6c-5e4ef1476375 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-ce23e40e-1172-4c11-aeda-441e4ba22935 tempest-CreateVolumesFromSnapshotTest-970769676 None] Created volume successfully. Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7b16dc68-47f3-4990-af6c-5e4ef1476375" returned: 0 in 0.378s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] <== create_volume: return (1332ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140740149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0e5b0a-0d7e-41c0-b692-4304e7491952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:36Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Creating volume 7e0e5b0a-0d7e-41c0-b692-4304e7491952 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:39 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:39 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=157, name=volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-b62dd334-79e2-4ac8-82ce-3d19a067ed3e-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c336b55a-489d-4d1f-bbbc-217f99783ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b16dc68-47f3-4990-af6c-5e4ef1476375', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b22688-63ee-4274-9ee2-25adea40ce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952 1073741824" returned: 0 in 0.958s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-b62dd334-79e2-4ac8-82ce-3d19a067ed3e-delete_volume" acquired by "delete_volume" :: waited 0.654s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:41 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume volume-7b16dc68-47f3-4990-af6c-5e4ef1476375 (7b16dc68-47f3-4990-af6c-5e4ef1476375): created successfully Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b22688-63ee-4274-9ee2-25adea40ce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (00eefeca-a3d8-4714-a675-8af07b813254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.796s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952" returned: 0 in 0.560s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:41 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8d8ce64c-801b-4c83-a843-4a1be4885e44 tempest-CreateVolumesFromSnapshotTest-970769676 None] Created volume successfully. Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] <== create_volume: return (1596ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:41 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Deleted volume successfully. Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.600s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1073300092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda25658-247a-4702-8299-f467338c232a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa66f08e5ae4cd599e3e8e0a138cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:37Z,use_quota=True,user_id='f46c8be0de2a42488308ca578f4de62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Creating volume fda25658-247a-4702-8299-f467338c232a {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:41 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fda25658-247a-4702-8299-f467338c232a 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:41 devstack quobyte-client[82625]: System call of process 100989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:41 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=158, name=volume-fda25658-247a-4702-8299-f467338c232a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:41 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-quobyte-b62dd334-79e2-4ac8-82ce-3d19a067ed3e" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b26d34-a501-4b31-b514-e2cd27c37029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f70349-63a8-462f-8bce-8e5a5cd8cfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fda25658-247a-4702-8299-f467338c232a 1073741824" returned: 0 in 0.542s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fda25658-247a-4702-8299-f467338c232a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-93a6e87f-adca-4a9d-8dff-7795b7486192 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-96e3931b-f4d2-4f36-8013-8f94dead458f-delete_volume" released by "delete_volume" :: held 9.003s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:42 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952 (7e0e5b0a-0d7e-41c0-b692-4304e7491952): created successfully Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f70349-63a8-462f-8bce-8e5a5cd8cfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (aee09b20-688f-4d0d-bec8-4ad2f645c246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-b62dd334-79e2-4ac8-82ce-3d19a067ed3e" acquired by "delete_volume" :: waited 0.552s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb456f2-24ae-4dac-b61e-9c01a952ca08]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fda25658-247a-4702-8299-f467338c232a" returned: 0 in 0.559s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] <== create_volume: return (1170ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:42 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-09422789-0576-4f87-865d-96ba49bf052e tempest-CreateVolumesFromSnapshotTest-970769676 None] Created volume successfully. Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8af519d-9736-477a-b27f-1bd44e952b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda25658-247a-4702-8299-f467338c232a', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b29403-39d0-4dd5-8731-53c93a4a2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:42 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume volume-fda25658-247a-4702-8299-f467338c232a (fda25658-247a-4702-8299-f467338c232a): created successfully Sep 10 18:07:42 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b29403-39d0-4dd5-8731-53c93a4a2f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:43 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Flow 'volume_create_manager' (874de036-4c2a-41ee-8deb-b198105acaf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:43 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-71b6f086-dfc4-4e80-8ea0-8aa420c2d517 tempest-CreateVolumesFromSnapshotTest-970769676 None] Created volume successfully. Sep 10 18:07:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e" returned: 0 in 0.604s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-b62dd334-79e2-4ac8-82ce-3d19a067ed3e" returned: 0 in 0.157s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-b62dd334-79e2-4ac8-82ce-3d19a067ed3e" released by "delete_volume" :: held 0.934s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:43 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Created reservations ['ed718d63-e4e0-4a4f-b487-51e27f5e5143', '8b6683ed-79b2-4bca-b30e-f2c12dd62db4', 'c243e48f-5801-4d55-ac62-32968438fd98', '87844844-24b6-4eb9-b3a4-78813da7c59e'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-fda25658-247a-4702-8299-f467338c232a-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-fda25658-247a-4702-8299-f467338c232a-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:44 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-quobyte-fda25658-247a-4702-8299-f467338c232a" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.390s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:44 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Deleted volume successfully. Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-6d406016-08ef-4e86-83f1-08dab6579647-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-fda25658-247a-4702-8299-f467338c232a" acquired by "delete_volume" :: waited 0.219s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b15a1f-166a-4e01-a1a6-391b0e73b3b5]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fda25658-247a-4702-8299-f467338c232a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-b44cd0de-c012-4060-881b-e7e7d05cff9d tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-b62dd334-79e2-4ac8-82ce-3d19a067ed3e-delete_volume" released by "delete_volume" :: held 4.062s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-6d406016-08ef-4e86-83f1-08dab6579647-delete_volume" acquired by "delete_volume" :: waited 0.348s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:45 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-quobyte-6d406016-08ef-4e86-83f1-08dab6579647" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fda25658-247a-4702-8299-f467338c232a" returned: 0 in 0.645s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fda25658-247a-4702-8299-f467338c232a {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-fda25658-247a-4702-8299-f467338c232a" returned: 0 in 0.174s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-6d406016-08ef-4e86-83f1-08dab6579647" acquired by "delete_volume" :: waited 0.226s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8ee96e-acbc-41ba-ac79-13d1d16d8307]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6d406016-08ef-4e86-83f1-08dab6579647 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-fda25658-247a-4702-8299-f467338c232a" released by "delete_volume" :: held 1.065s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Created reservations ['48b855a2-2778-491f-a873-ca3715adc520', '787d2357-488d-466e-b805-ffb3312fdc41', '078f4228-66a2-4136-b5d7-4497537864cd', '3b95c2bb-6b21-4868-848a-4b98a89b7043'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6d406016-08ef-4e86-83f1-08dab6579647" returned: 0 in 0.696s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6d406016-08ef-4e86-83f1-08dab6579647 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6d406016-08ef-4e86-83f1-08dab6579647" returned: 0 in 0.228s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-6d406016-08ef-4e86-83f1-08dab6579647" released by "delete_volume" :: held 1.099s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.289s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:47 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Deleted volume successfully. Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Created reservations ['009b2403-7f11-47c2-9ab5-c83a5c72fabb', '89bf2301-5f4b-4388-b218-78fbd2ddb282', '529fb594-6b8f-40c2-b34e-2470f61db5c7', 'f842554d-33c5-478d-92a4-ce55980c2082'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8c9511c7-8380-4746-bd52-bb282fb8e091 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-fda25658-247a-4702-8299-f467338c232a-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-7e0e5b0a-0d7e-41c0-b692-4304e7491952-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-7e0e5b0a-0d7e-41c0-b692-4304e7491952-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:47 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-quobyte-7e0e5b0a-0d7e-41c0-b692-4304e7491952" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-7e0e5b0a-0d7e-41c0-b692-4304e7491952" acquired by "delete_volume" :: waited 0.025s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[01530701-47f8-4ebe-a8bd-af0e4feaeb11]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.051s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-c8aff7f6-11b6-4a32-9773-88947674aa53-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.465s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:48 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Deleted volume successfully. Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-c8aff7f6-11b6-4a32-9773-88947674aa53-delete_volume" acquired by "delete_volume" :: waited 0.337s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952" returned: 0 in 0.992s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:48 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7ffbad74-2fa2-4692-9cdb-afa3db511405 tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-6d406016-08ef-4e86-83f1-08dab6579647-delete_volume" released by "delete_volume" :: held 4.092s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7e0e5b0a-0d7e-41c0-b692-4304e7491952" returned: 0 in 0.463s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:49 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "cinder-quobyte-c8aff7f6-11b6-4a32-9773-88947674aa53" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-7e0e5b0a-0d7e-41c0-b692-4304e7491952" released by "delete_volume" :: held 1.562s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-c8aff7f6-11b6-4a32-9773-88947674aa53" acquired by "delete_volume" :: waited 0.061s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:49 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5ad05a-1bc0-4d38-83d2-bd24016c5363]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8aff7f6-11b6-4a32-9773-88947674aa53 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:49 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Created reservations ['a6faf574-3a6b-43a8-ba55-dbb85b391930', '673ac24d-08fc-4fe7-9e34-ea1c98d22efa', 'a0f7df38-f0d2-437c-972c-64c4f5586010', '7702c36d-6bb5-4a25-bc03-ce0325ee882c'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8aff7f6-11b6-4a32-9773-88947674aa53" returned: 0 in 0.845s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8aff7f6-11b6-4a32-9773-88947674aa53 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.230s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c8aff7f6-11b6-4a32-9773-88947674aa53" returned: 0 in 0.284s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:50 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Deleted volume successfully. Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-quobyte-c8aff7f6-11b6-4a32-9773-88947674aa53" released by "delete_volume" :: held 1.423s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1304356c-3ab6-49d8-96f5-7dd1b76f7cae tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-7e0e5b0a-0d7e-41c0-b692-4304e7491952-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Created reservations ['b0576b96-05e1-4800-8d5b-6f7bbe913cf1', '411fd861-bde4-4bdf-b5d3-c606540f3bd6', '37ed6f77-0e30-49ed-bfd9-8d0147ca6557', 'd2cbda16-055d-44d6-ab4e-27f603594bed'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-7b16dc68-47f3-4990-af6c-5e4ef1476375-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-7b16dc68-47f3-4990-af6c-5e4ef1476375-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:51 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-quobyte-7b16dc68-47f3-4990-af6c-5e4ef1476375" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-7b16dc68-47f3-4990-af6c-5e4ef1476375" acquired by "delete_volume" :: waited 0.033s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[862006dc-1713-4cc9-9fa9-681c1856cd1b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7b16dc68-47f3-4990-af6c-5e4ef1476375 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:51 devstack quobyte-client[82625]: System call of process 101022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.302s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:52 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:52 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Deleted volume successfully. Sep 10 18:07:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7b16dc68-47f3-4990-af6c-5e4ef1476375" returned: 0 in 0.836s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7b16dc68-47f3-4990-af6c-5e4ef1476375 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:52 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-7da59aa2-75ce-4206-b0ae-c5775c0457cb tempest-CreateVolumesFromImageTest-1431517176 None] Lock "cinder-c8aff7f6-11b6-4a32-9773-88947674aa53-delete_volume" released by "delete_volume" :: held 3.752s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-7b16dc68-47f3-4990-af6c-5e4ef1476375" returned: 0 in 0.327s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:52 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-7b16dc68-47f3-4990-af6c-5e4ef1476375" released by "delete_volume" :: held 1.231s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:52 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Created reservations ['e6bd7ce0-7a78-43e2-b9c2-b18fac70110c', 'c6a71fe8-84d1-4ae1-bc8c-b6113471481d', '7d38e457-f9b0-4c0d-864f-c126657f9434', '43824030-99ab-45fa-a4c9-0e196d1ea2c7'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.144s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:53 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Deleted volume successfully. Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-32d04bbb-7ecc-4dc2-aabc-2969b398e1b8 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-7b16dc68-47f3-4990-af6c-5e4ef1476375-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-3a5d4cf2-adf2-4959-8116-c241fd5bbc13-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:53 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-3a5d4cf2-adf2-4959-8116-c241fd5bbc13-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:54 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-quobyte-3a5d4cf2-adf2-4959-8116-c241fd5bbc13" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-3a5d4cf2-adf2-4959-8116-c241fd5bbc13" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:54 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a914c00-7fd7-4b1e-a8fb-94f866696ada]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13" returned: 0 in 0.581s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:54 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-3a5d4cf2-adf2-4959-8116-c241fd5bbc13" returned: 0 in 0.195s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-3a5d4cf2-adf2-4959-8116-c241fd5bbc13" released by "delete_volume" :: held 1.144s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Created reservations ['af521144-146d-46e2-a31b-169bb06f730b', 'c2f34d18-fcb9-4939-a7a8-566def07f7c6', '48c2ef07-1b67-4801-b8fc-f15df60733bb', 'd13a8065-4475-4bf6-a253-3d553d1e5b32'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.122s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:55 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:56 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Deleted volume successfully. Sep 10 18:07:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-a794dd06-753a-4973-9eaf-f6ff41c19f18-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-243e2ea7-63d8-4bab-b146-aec2758865bd tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-3a5d4cf2-adf2-4959-8116-c241fd5bbc13-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-a794dd06-753a-4973-9eaf-f6ff41c19f18-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:56 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-quobyte-a794dd06-753a-4973-9eaf-f6ff41c19f18" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:07:56 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-a794dd06-753a-4973-9eaf-f6ff41c19f18" acquired by "delete_volume" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:07:56 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc94781-6cae-4947-a752-6dc67d3d899f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:56 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a794dd06-753a-4973-9eaf-f6ff41c19f18 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:57 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Flow 'volume_create_manager' (1f610da5-2300-4b5e-99de-0e42886a3818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1d6268-8f60-4ee7-b485-5e3deb4ae14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a794dd06-753a-4973-9eaf-f6ff41c19f18" returned: 0 in 0.757s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a794dd06-753a-4973-9eaf-f6ff41c19f18 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1d6268-8f60-4ee7-b485-5e3deb4ae14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-293048935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094f7638-7c19-449b-8897-aa8b57c122b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b136a0624fd84a6597b0fb24c4ebaf51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:57Z,use_quota=True,user_id='349182937dcf4013be997694803e24bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd52da2-e35b-4197-9a95-ea592d364655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd52da2-e35b-4197-9a95-ea592d364655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50433db-a64f-436c-9b75-8123aded2602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50433db-a64f-436c-9b75-8123aded2602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094f7638-7c19-449b-8897-aa8b57c122b7', 'volume_name': 'volume-094f7638-7c19-449b-8897-aa8b57c122b7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fd6231-53b2-4c95-a2fd-943d1d5cf880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fd6231-53b2-4c95-a2fd-943d1d5cf880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a21e863-e6b3-4116-a560-fd9a4bc90499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:57 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Volume 094f7638-7c19-449b-8897-aa8b57c122b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094f7638-7c19-449b-8897-aa8b57c122b7', 'volume_size': 1} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-293048935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094f7638-7c19-449b-8897-aa8b57c122b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b136a0624fd84a6597b0fb24c4ebaf51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:07:57Z,use_quota=True,user_id='349182937dcf4013be997694803e24bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Creating volume 094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:07:57 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:57 devstack quobyte-client[82625]: System call of process 101038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:07:57 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a794dd06-753a-4973-9eaf-f6ff41c19f18" returned: 0 in 0.478s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:57 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=159, name=volume-094f7638-7c19-449b-8897-aa8b57c122b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-a794dd06-753a-4973-9eaf-f6ff41c19f18" released by "delete_volume" :: held 1.455s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 1073741824" returned: 0 in 0.532s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7" returned: 0 in 0.256s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] <== create_volume: return (830ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a21e863-e6b3-4116-a560-fd9a4bc90499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094f7638-7c19-449b-8897-aa8b57c122b7', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85aea94b-b2fe-4c5d-8b32-407508ba72ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:07:58 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Volume volume-094f7638-7c19-449b-8897-aa8b57c122b7 (094f7638-7c19-449b-8897-aa8b57c122b7): created successfully Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85aea94b-b2fe-4c5d-8b32-407508ba72ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Flow 'volume_create_manager' (1f610da5-2300-4b5e-99de-0e42886a3818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Created reservations ['110ec9cf-b26a-4adb-9d38-16c00ba2e5e8', 'd4592a93-1951-4115-b8a3-f2d1f6c58aaa', '983f0f15-d08a-4e5a-8721-b0c74a4c8747', 'fdaf5c39-cb5b-4476-a2d4-30676f5d7fb9'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:07:58 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d5f2a3a4-0842-408d-a392-da065725509d tempest-SnapshotDependencyTests-846578452 None] Created volume successfully. Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:07:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.123s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:07:59 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Deleted volume successfully. Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-66946484-73fd-491d-bcdd-38a1d1242783 tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-a794dd06-753a-4973-9eaf-f6ff41c19f18-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:07:59 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Creating offline snapshot 43a12a38-15e4-449b-9687-35aa9f8c6f55 of volume 094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8531d3c-9e61-4a0a-a5ca-4b5c531a0f0b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:07:59 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-53eefe13-0324-4c2c-86fa-5dfed6398886-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-53eefe13-0324-4c2c-86fa-5dfed6398886-delete_snapshot" acquired by "delete_snapshot" :: waited 0.139s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:00 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-quobyte-6ea293a0-d184-496a-b838-ccded703ee41" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-6ea293a0-d184-496a-b838-ccded703ee41" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-quobyte-53eefe13-0324-4c2c-86fa-5dfed6398886" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-53eefe13-0324-4c2c-86fa-5dfed6398886" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Deleting offline snapshot 53eefe13-0324-4c2c-86fa-5dfed6398886 of volume 6ea293a0-d184-496a-b838-ccded703ee41 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] snapshot_file for this snap is: volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4096d8-ccff-4d47-a5d7-219d6ce0ee16]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7" returned: 0 in 0.752s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:00 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=160, name=volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 1G" returned: 0 in 0.360s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:00 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): qemu-img rebase -u -b volume-094f7638-7c19-449b-8897-aa8b57c122b7 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886" returned: 0 in 1.047s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ea293a0-d184-496a-b838-ccded703ee41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] CMD "qemu-img rebase -u -b volume-094f7638-7c19-449b-8897-aa8b57c122b7 -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55" returned: 0 in 0.377s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a8048-0606-4fce-9896-c7f76d9f5a53]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:01 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Flow 'volume_create_manager' (d4c4851d-b587-4d30-b5c5-ed4f5bd9f105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583cc4f4-a4d6-42a0-8206-5b7b285d6a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583cc4f4-a4d6-42a0-8206-5b7b285d6a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982a8e33-85bb-4abb-919e-a3f1515c0641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eebe4868e3b4d8cb1800d4ac6b6e9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:01Z,use_quota=True,user_id='bb4507df90f24e55a19de53170a7742c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356284a4-df72-47ff-bb53-46e47fbdc359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356284a4-df72-47ff-bb53-46e47fbdc359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d75311-d3bc-4dd4-971d-b70d89da7382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55" returned: 0 in 0.871s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:02 devstack quobyte-client[82625]: System call of process 101057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55" returned: 0 in 0.183s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41" returned: 0 in 0.672s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.info" returned: 0 in 0.384s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:08:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886" returned: 0 in 0.486s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.info" returned: 0 in 0.438s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.708s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d75311-d3bc-4dd4-971d-b70d89da7382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '982a8e33-85bb-4abb-919e-a3f1515c0641', 'volume_name': 'volume-982a8e33-85bb-4abb-919e-a3f1515c0641', 'volume_size': 1, 'image_id': '5ccd1e35-778d-4c33-8600-79b4a53291ea', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20de7718a6ec1b32b47087a7f486ed5f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1eebe4868e3b4d8cb1800d4ac6b6e9ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54abd6fb273ecc5ff7481380325b92514a8c31d1cecc1fe25ca8dc68cc71e72cd0572b7ce9241706dc7a938f38257a7b4c8de2fbd985c88c9593006d1c554d03', 'id': '5ccd1e35-778d-4c33-8600-79b4a53291ea', 'created_at': datetime.datetime(2025, 9, 10, 16, 7, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ccd1e35-778d-4c33-8600-79b4a53291ea/file', 'properties': {}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17a8867-48c8-470d-8e09-50cd33e46698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17a8867-48c8-470d-8e09-50cd33e46698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959953ec-5a2f-46a9-af2a-2424ebb1d234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:03 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Volume 982a8e33-85bb-4abb-919e-a3f1515c0641: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-982a8e33-85bb-4abb-919e-a3f1515c0641', 'volume_size': 1, 'image_id': '5ccd1e35-778d-4c33-8600-79b4a53291ea', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20de7718a6ec1b32b47087a7f486ed5f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1eebe4868e3b4d8cb1800d4ac6b6e9ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54abd6fb273ecc5ff7481380325b92514a8c31d1cecc1fe25ca8dc68cc71e72cd0572b7ce9241706dc7a938f38257a7b4c8de2fbd985c88c9593006d1c554d03', 'id': '5ccd1e35-778d-4c33-8600-79b4a53291ea', 'created_at': datetime.datetime(2025, 9, 10, 16, 7, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ccd1e35-778d-4c33-8600-79b4a53291ea/file', 'properties': {}}, 'image_service': } Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Cloning 982a8e33-85bb-4abb-919e-a3f1515c0641 from image 5ccd1e35-778d-4c33-8600-79b4a53291ea at location (None, None). {{(pid=82609) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41.53eefe13-0324-4c2c-86fa-5dfed6398886" returned: 0 in 0.590s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-53eefe13-0324-4c2c-86fa-5dfed6398886" released by "_delete_snapshot" :: held 3.525s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-6ea293a0-d184-496a-b838-ccded703ee41" released by "delete_snapshot" :: held 3.622s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:03 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-22130c82-0ae6-4c4c-9855-1353ec0597ae tempest-SnapshotDependencyTests-846578452 None] Create snapshot completed successfully Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 18:08:03 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Image download 0.00 MB at 0.00 MB/s Sep 10 18:08:03 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Created reservations ['afc8569d-f74a-4922-adaa-1fd167460812', '79d2942d-5a5e-4370-b0bc-66f1c798def7', 'c663d609-6cde-4d58-adf2-0ea8b5d173eb', 'b5ec9396-146a-43c8-96d9-4e81586ad7e5'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:04 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec532d2e-73ea-401f-b470-148b206b3a02]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-6ea293a0-d184-496a-b838-ccded703ee41-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:04 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD Sep 10 18:08:04 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:08:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-6ea293a0-d184-496a-b838-ccded703ee41-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:06 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Sep 10 18:08:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD" returned: 0 in 2.262s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:06 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD Sep 10 18:08:06 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:08:06 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Delete snapshot completed successfully. Sep 10 18:08:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-f7012536-f436-4f82-8471-c19a967efe6b tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-53eefe13-0324-4c2c-86fa-5dfed6398886-delete_snapshot" released by "delete_snapshot" :: held 6.985s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:07 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "cinder-quobyte-6ea293a0-d184-496a-b838-ccded703ee41" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:07 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-6ea293a0-d184-496a-b838-ccded703ee41" acquired by "delete_volume" :: waited 0.037s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:07 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ddd2c-c8d4-4d90-be39-450ad2f5d811]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:07 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:07 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:08 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41" returned: 0 in 0.690s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Flow 'volume_create_manager' (50744c11-2b57-4459-8514-38be5779141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f7ce15-93b6-4a35-a611-97bc646516a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-6ea293a0-d184-496a-b838-ccded703ee41" returned: 0 in 0.781s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:08 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f7ce15-93b6-4a35-a611-97bc646516a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733f1b2c-b8ab-442c-b070-6baa93a0d54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b136a0624fd84a6597b0fb24c4ebaf51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43a12a38-15e4-449b-9687-35aa9f8c6f55,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:07Z,use_quota=True,user_id='349182937dcf4013be997694803e24bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c23ef11-b2f0-417d-bea7-602ea3094bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c23ef11-b2f0-417d-bea7-602ea3094bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a060a2-3c01-4959-b8d7-2528e8fcfb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a060a2-3c01-4959-b8d7-2528e8fcfb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '733f1b2c-b8ab-442c-b070-6baa93a0d54f', 'volume_name': 'volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f', 'volume_size': 1, 'snapshot_id': '43a12a38-15e4-449b-9687-35aa9f8c6f55'}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87a0751-617a-4be5-aebb-ec6c51bf79e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:09 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87a0751-617a-4be5-aebb-ec6c51bf79e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64de26a-1647-433d-b132-0d8e0fb420a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:09 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Volume 733f1b2c-b8ab-442c-b070-6baa93a0d54f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f', 'volume_size': 1, 'snapshot_id': '43a12a38-15e4-449b-9687-35aa9f8c6f55'} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-quobyte-43a12a38-15e4-449b-9687-35aa9f8c6f55-733f1b2c-b8ab-442c-b070-6baa93a0d54f" by "_create_volume_from_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-quobyte-6ea293a0-d184-496a-b838-ccded703ee41" released by "delete_volume" :: held 1.755s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD" returned: 1 in 2.844s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Temporary image 5ccd1e35-778d-4c33-8600-79b4a53291ea is fetched for user bb4507df90f24e55a19de53170a7742c. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-43a12a38-15e4-449b-9687-35aa9f8c6f55-733f1b2c-b8ab-442c-b070-6baa93a0d54f" acquired by "_create_volume_from_snapshot" :: waited 0.087s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Creating volume 733f1b2c-b8ab-442c-b070-6baa93a0d54f from snapshot 43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-quobyte-733f1b2c-b8ab-442c-b070-6baa93a0d54f" by "_copy_volume_from_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-733f1b2c-b8ab-442c-b070-6baa93a0d54f" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] snapshot: 43a12a38-15e4-449b-9687-35aa9f8c6f55, volume: 733f1b2c-b8ab-442c-b070-6baa93a0d54f, {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70238d0-4998-4fa8-b067-3845461dbc88]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f7fadd-0a15-4aed-b3b7-13e97db94e6d]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Created reservations ['33cb3316-e782-49b8-8f5b-7c06b1eb4269', '2532c163-e188-4db9-a618-6654bdb1846c', '48d27be1-068b-471a-98c7-e3079ec7dcf2', '4afe5b2e-ab09-4a7e-b221-75592587c04b'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=120,cinder:SELECT=73,cinder:DELETE=14,cinder:INSERT=20 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:08:09 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=82,cinder:UPDATE=109,cinder:DELETE=10,cinder:INSERT=29 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:08:09 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD Sep 10 18:08:09 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55" returned: 0 in 0.824s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-094f7638-7c19-449b-8897-aa8b57c122b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Creating direct copy from snapshot {{(pid=82609) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[093d55b0-6080-460a-a381-186fb618203e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.303s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:10 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Deleted volume successfully. Sep 10 18:08:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-8b721b53-5694-4206-be8a-a72ae95181cf tempest-CreateVolumesFromSnapshotTest-970769676 None] Lock "cinder-6ea293a0-d184-496a-b838-ccded703ee41-delete_volume" released by "delete_volume" :: held 6.032s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7" returned: 0 in 0.673s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:11 devstack cinder-volume[82609]: DEBUG cinder.utils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f not found in is_blk_device check {{(pid=82609) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 18:08:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:11 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=162, name=volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:14 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 10 18:08:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD" returned: 0 in 5.152s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:14 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:15 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD Sep 10 18:08:15 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:08:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f" returned: 0 in 7.527s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:18 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9b9b1b-56f1-4d17-baba-14f5a63014b6]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:18 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:19 devstack quobyte-client[82625]: System call of process 101145 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7" returned: 0 in 0.988s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:19 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 18:08:19 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Converted 1024.00 MB image at 135.20 MB/s Sep 10 18:08:19 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:08:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:19 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 10 18:08:19 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f" returned: 0 in 0.221s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-733f1b2c-b8ab-442c-b070-6baa93a0d54f" released by "_copy_volume_from_snapshot" :: held 10.825s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD" returned: 1 in 5.289s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=13,cinder:SELECT=3 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-43a12a38-15e4-449b-9687-35aa9f8c6f55-733f1b2c-b8ab-442c-b070-6baa93a0d54f" released by "_create_volume_from_snapshot" :: held 10.980s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.075s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982a8e33-85bb-4abb-919e-a3f1515c0641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eebe4868e3b4d8cb1800d4ac6b6e9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:01Z,use_quota=True,user_id='bb4507df90f24e55a19de53170a7742c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Creating volume 982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:20 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:20 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=163, name=volume-982a8e33-85bb-4abb-919e-a3f1515c0641, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64de26a-1647-433d-b132-0d8e0fb420a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f', 'volume_size': 1, 'snapshot_id': '43a12a38-15e4-449b-9687-35aa9f8c6f55'}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1a433e-160d-4d6f-82db-e630c408e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 1073741824" returned: 0 in 0.560s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:20 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:21 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Volume volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f (733f1b2c-b8ab-442c-b070-6baa93a0d54f): created successfully Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1a433e-160d-4d6f-82db-e630c408e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Flow 'volume_create_manager' (50744c11-2b57-4459-8514-38be5779141a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-43a12a38-15e4-449b-9687-35aa9f8c6f55-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641" returned: 0 in 0.548s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] <== create_volume: return (1139ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-43a12a38-15e4-449b-9687-35aa9f8c6f55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-quobyte-094f7638-7c19-449b-8897-aa8b57c122b7" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-094f7638-7c19-449b-8897-aa8b57c122b7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-quobyte-43a12a38-15e4-449b-9687-35aa9f8c6f55" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:21 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-95dfbf85-3957-41f0-9709-431975ed546b tempest-SnapshotDependencyTests-846578452 None] Created volume successfully. Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-43a12a38-15e4-449b-9687-35aa9f8c6f55" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Deleting offline snapshot 43a12a38-15e4-449b-9687-35aa9f8c6f55 of volume 094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] snapshot_file for this snap is: volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 18:08:21 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (2bed156c-6c24-4061-b380-f1d5791cd1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e132f000-1817-40c0-8d2e-187ff14ce672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4057dc-9dcd-404e-8d00-27e88ce2920b]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:21 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Attempting download of 5ccd1e35-778d-4c33-8600-79b4a53291ea ((None, None)) to volume 982a8e33-85bb-4abb-919e-a3f1515c0641. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e132f000-1817-40c0-8d2e-187ff14ce672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-374416336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932344de-3526-40ad-ab56-b0b8f1b65ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:21Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5024cf77-1914-4db6-ba70-d6b4d3ff8c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5024cf77-1914-4db6-ba70-d6b4d3ff8c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcb3c93-4182-4bc9-8ac2-1b030a97b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcb3c93-4182-4bc9-8ac2-1b030a97b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932344de-3526-40ad-ab56-b0b8f1b65ff8', 'volume_name': 'volume-932344de-3526-40ad-ab56-b0b8f1b65ff8', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56927ec8-d705-4073-8a8d-4921254148be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56927ec8-d705-4073-8a8d-4921254148be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c511907f-7583-42e1-811b-0699e109025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:22 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume 932344de-3526-40ad-ab56-b0b8f1b65ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932344de-3526-40ad-ab56-b0b8f1b65ff8', 'volume_size': 1} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-374416336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932344de-3526-40ad-ab56-b0b8f1b65ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:21Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Creating volume 932344de-3526-40ad-ab56-b0b8f1b65ff8 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:22 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-932344de-3526-40ad-ab56-b0b8f1b65ff8 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:22 devstack quobyte-client[82625]: System call of process 101156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:22 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=164, name=volume-932344de-3526-40ad-ab56-b0b8f1b65ff8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55" returned: 0 in 0.811s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-094f7638-7c19-449b-8897-aa8b57c122b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb3508d-7770-40aa-9040-f680f81aea5f]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[590507b2-7b05-405d-8760-a0c79388473f]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ccd1e35-778d-4c33-8600-79b4a53291ea_09g8dcnj {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-932344de-3526-40ad-ab56-b0b8f1b65ff8 1073741824" returned: 0 in 0.556s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-932344de-3526-40ad-ab56-b0b8f1b65ff8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:22 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-932344de-3526-40ad-ab56-b0b8f1b65ff8" returned: 0 in 0.149s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] <== create_volume: return (883ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:23 devstack quobyte-client[82625]: System call of process 101162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7" returned: 0 in 0.686s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ccd1e35-778d-4c33-8600-79b4a53291ea_09g8dcnj" returned: 0 in 0.735s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c511907f-7583-42e1-811b-0699e109025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932344de-3526-40ad-ab56-b0b8f1b65ff8', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff601d00-5ef6-44d2-be35-79ddc793d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ccd1e35-778d-4c33-8600-79b4a53291ea_09g8dcnj {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55" returned: 0 in 0.474s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:23 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume volume-932344de-3526-40ad-ab56-b0b8f1b65ff8 (932344de-3526-40ad-ab56-b0b8f1b65ff8): created successfully Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff601d00-5ef6-44d2-be35-79ddc793d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:23 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (2bed156c-6c24-4061-b380-f1d5791cd1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7.43a12a38-15e4-449b-9687-35aa9f8c6f55" returned: 0 in 0.402s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ccd1e35-778d-4c33-8600-79b4a53291ea_09g8dcnj" returned: 1 in 0.640s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ccd1e35-778d-4c33-8600-79b4a53291ea_09g8dcnj' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:08:24 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-b1ddc738-bcac-4e02-8cf5-6087451c67c9 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created volume successfully. Sep 10 18:08:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-43a12a38-15e4-449b-9687-35aa9f8c6f55" released by "_delete_snapshot" :: held 2.795s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:24 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[249cd82b-6255-4c60-8661-41d535453689]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:24 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:24 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-094f7638-7c19-449b-8897-aa8b57c122b7" released by "delete_snapshot" :: held 3.075s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:24 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:24 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (7d54e918-c7d1-4ccd-8304-4f410bbf3470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ac1765-ecd5-4f0f-ad1c-1d4141b0b81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ac1765-ecd5-4f0f-ad1c-1d4141b0b81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1659784914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6730618-96fb-4f24-a23d-7fb3c2fca9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:25Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725aea8e-6d59-4567-8cdd-1c701b7f5a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725aea8e-6d59-4567-8cdd-1c701b7f5a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7581d0-2e6d-4fb7-94c3-437ebda58494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7581d0-2e6d-4fb7-94c3-437ebda58494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6730618-96fb-4f24-a23d-7fb3c2fca9d3', 'volume_name': 'volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80156f10-9acb-47e4-8062-3989f5d6a5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80156f10-9acb-47e4-8062-3989f5d6a5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a35dc1-3f6a-4be7-83d3-81166d8dfced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:25 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume a6730618-96fb-4f24-a23d-7fb3c2fca9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3', 'volume_size': 1} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1659784914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6730618-96fb-4f24-a23d-7fb3c2fca9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:25Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Creating volume a6730618-96fb-4f24-a23d-7fb3c2fca9d3 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:25 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:25 devstack quobyte-client[82625]: System call of process 101178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:25 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=165, name=volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:25 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Created reservations ['f5abf788-aba0-445a-b43e-95ab43a11e4c', 'a10d6266-3558-4987-9a77-ce20bdf4b27a', 'a29d0db0-5f23-4518-8de3-4a9df0380962', '2548180b-788b-4497-b1ed-3dfa05891e04'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD" returned: 1 in 1.096s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:08:26 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] 5ccd1e35-778d-4c33-8600-79b4a53291ea was raw, converting to raw {{(pid=82609) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 18:08:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:26 devstack quobyte-client[82625]: System call of process 101183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:26 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=163, name=volume-982a8e33-85bb-4abb-919e-a3f1515c0641, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3 1073741824" returned: 0 in 1.062s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:26 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:27 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (f74c08e2-656a-4a73-865c-894c64e2d669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21ba516-f6d7-4ca4-8c40-d4b841fc7710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:27 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (787bbf6e-21f4-4449-825d-2d1de4fb9ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4c2ab3-e512-4919-814e-9e706ddc8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641" returned: 0 in 1.054s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ccd1e35-778d-4c33-8600-79b4a53291ea_9nxnq0bqdevstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 18:08:27 devstack cinder-volume[82609]: INFO cinder.image.image_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:27 devstack quobyte-client[82625]: System call of process 101187 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21ba516-f6d7-4ca4-8c40-d4b841fc7710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421902269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212ba53e-f9b8-49e9-87dc-d6803af44ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:26Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea32c31-a62c-49fe-9d9e-ea17072aed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea32c31-a62c-49fe-9d9e-ea17072aed81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97869ba-5308-40ee-9615-1b7546ed4b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97869ba-5308-40ee-9615-1b7546ed4b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212ba53e-f9b8-49e9-87dc-d6803af44ddc', 'volume_name': 'volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c04ad8-c532-4839-88a7-d91cf29d3c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c04ad8-c532-4839-88a7-d91cf29d3c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a442124d-d8ce-4d8b-baff-c6c68fd71c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:27 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume 212ba53e-f9b8-49e9-87dc-d6803af44ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc', 'volume_size': 1} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3" returned: 0 in 1.122s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] <== create_volume: return (2350ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.371s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421902269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212ba53e-f9b8-49e9-87dc-d6803af44ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:26Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Creating volume 212ba53e-f9b8-49e9-87dc-d6803af44ddc {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:27 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:08:27 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:28 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=166, name=volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4c2ab3-e512-4919-814e-9e706ddc8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-227002932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b0a643-ba74-4a54-912c-75998938fcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:25Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b79f34-3358-4229-b655-416e56555db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b79f34-3358-4229-b655-416e56555db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad32644a-4f77-4f7f-9351-956fe509a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad32644a-4f77-4f7f-9351-956fe509a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b0a643-ba74-4a54-912c-75998938fcff', 'volume_name': 'volume-f7b0a643-ba74-4a54-912c-75998938fcff', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2349d224-01f5-48d0-af19-c4d627d1dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2349d224-01f5-48d0-af19-c4d627d1dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2de5a3-891a-4635-9bc6-7742588b408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:28 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume f7b0a643-ba74-4a54-912c-75998938fcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b0a643-ba74-4a54-912c-75998938fcff', 'volume_size': 1} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-094f7638-7c19-449b-8897-aa8b57c122b7-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a35dc1-3f6a-4be7-83d3-81166d8dfced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a038063-a2c9-4bea-9fe6-ba268fc929be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:28 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (8659e5db-bb1a-45b7-979e-c970a0ce5066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e62f73-04b8-40d4-9636-116c7c50a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:28 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:28 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (8cc250cc-502f-405f-9bde-21b0c0fec2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2d2134-9c03-42b3-8a62-b048da65b3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Delete snapshot completed successfully. Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2d2134-9c03-42b3-8a62-b048da65b3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371346016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001cc020-c2a5-4dbe-bfd2-5c64a2fcb644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:27Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b2a46b-8406-46e5-9f22-61dc843fed96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b2a46b-8406-46e5-9f22-61dc843fed96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fe0a53-8845-440f-9a50-870a1555d22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fe0a53-8845-440f-9a50-870a1555d22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001cc020-c2a5-4dbe-bfd2-5c64a2fcb644', 'volume_name': 'volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb7cb95-1d71-438b-bc03-584ea16a49ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb7cb95-1d71-438b-bc03-584ea16a49ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebe2f96-58e1-41d3-a1dc-6da9034dca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume 001cc020-c2a5-4dbe-bfd2-5c64a2fcb644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644', 'volume_size': 1} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 1G" returned: 0 in 2.222s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e62f73-04b8-40d4-9636-116c7c50a477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759593334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89b62ec-6ff8-4071-b699-b125473b023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:27Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1f4a7b-03d1-47c3-8bdf-92a7e8b09811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1f4a7b-03d1-47c3-8bdf-92a7e8b09811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f78c4cd-2bfc-4798-82d9-94f59e79055a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f78c4cd-2bfc-4798-82d9-94f59e79055a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89b62ec-6ff8-4071-b699-b125473b023e', 'volume_name': 'volume-c89b62ec-6ff8-4071-b699-b125473b023e', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28bce48f-f451-4ea4-a7a5-b289c6229137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28bce48f-f451-4ea4-a7a5-b289c6229137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13913f4-af6c-432c-ae32-9db3b7fc14aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:29 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume c89b62ec-6ff8-4071-b699-b125473b023e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89b62ec-6ff8-4071-b699-b125473b023e', 'volume_size': 1} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc 1073741824" returned: 0 in 1.705s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 1.214s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-094f7638-7c19-449b-8897-aa8b57c122b7-delete_volume" acquired by "delete_volume" :: waited 1.105s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-6cae6e1b-81fc-4197-874c-d7c7d877b93c tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-43a12a38-15e4-449b-9687-35aa9f8c6f55-delete_snapshot" released by "delete_snapshot" :: held 8.172s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:29 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3 (a6730618-96fb-4f24-a23d-7fb3c2fca9d3): created successfully Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a038063-a2c9-4bea-9fe6-ba268fc929be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (7d54e918-c7d1-4ccd-8304-4f410bbf3470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0af76-6f2d-4db6-93cd-a69d10a0a7e6]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:29 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:30 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-2125e6bf-232e-416b-8d5f-cb7e4cd66588 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created volume successfully. Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc" returned: 0 in 0.811s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] <== create_volume: return (2669ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.684s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-227002932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b0a643-ba74-4a54-912c-75998938fcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:25Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Creating volume f7b0a643-ba74-4a54-912c-75998938fcff {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:30 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:08:30 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7b0a643-ba74-4a54-912c-75998938fcff 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:30 devstack quobyte-client[82625]: System call of process 101197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:30 devstack quobyte-client[82625]: System call of process 101197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:30 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=167, name=volume-f7b0a643-ba74-4a54-912c-75998938fcff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:31 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-quobyte-094f7638-7c19-449b-8897-aa8b57c122b7" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a442124d-d8ce-4d8b-baff-c6c68fd71c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2feb7eae-d31f-458e-a812-a423be8f0797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641" returned: 0 in 1.295s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:31 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc (212ba53e-f9b8-49e9-87dc-d6803af44ddc): created successfully Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2feb7eae-d31f-458e-a812-a423be8f0797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (f74c08e2-656a-4a73-865c-894c64e2d669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7b0a643-ba74-4a54-912c-75998938fcff 1073741824" returned: 0 in 1.101s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7b0a643-ba74-4a54-912c-75998938fcff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:31 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-094f7638-7c19-449b-8897-aa8b57c122b7" acquired by "delete_volume" :: waited 0.803s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef5fb69-95ef-4c0a-a65f-2d96ba7d7094]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:32 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-52d27d7a-2032-41ec-a93d-2b016ee4f667 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created volume successfully. Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7b0a643-ba74-4a54-912c-75998938fcff" returned: 0 in 0.482s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] <== create_volume: return (1677ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641" returned: 1 in 1.091s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371346016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001cc020-c2a5-4dbe-bfd2-5c64a2fcb644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:27Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Creating volume 001cc020-c2a5-4dbe-bfd2-5c64a2fcb644 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:32 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Downloaded image 5ccd1e35-778d-4c33-8600-79b4a53291ea ((None, None)) to volume 982a8e33-85bb-4abb-919e-a3f1515c0641 successfully. {{(pid=82609) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.image.image_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Temporary image 5ccd1e35-778d-4c33-8600-79b4a53291ea for user bb4507df90f24e55a19de53170a7742c is deleted. {{(pid=82609) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.volume_utils [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Marking volume 982a8e33-85bb-4abb-919e-a3f1515c0641 as bootable. {{(pid=82609) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 18:08:32 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=168, name=volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2de5a3-891a-4635-9bc6-7742588b408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b0a643-ba74-4a54-912c-75998938fcff', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fab4722-7618-4dec-894f-caa8cdc45dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Copying metadata from image 5ccd1e35-778d-4c33-8600-79b4a53291ea to 982a8e33-85bb-4abb-919e-a3f1515c0641. {{(pid=82609) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:08:32 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Creating volume glance metadata for volume 982a8e33-85bb-4abb-919e-a3f1515c0641 backed by image 5ccd1e35-778d-4c33-8600-79b4a53291ea with: {'image_id': '5ccd1e35-778d-4c33-8600-79b4a53291ea', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '20de7718a6ec1b32b47087a7f486ed5f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82609) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:08:33 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume volume-f7b0a643-ba74-4a54-912c-75998938fcff (f7b0a643-ba74-4a54-912c-75998938fcff): created successfully Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fab4722-7618-4dec-894f-caa8cdc45dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (787bbf6e-21f4-4449-825d-2d1de4fb9ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7" returned: 0 in 0.976s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644 1073741824" returned: 0 in 0.800s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:33 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-828ebffd-3ac8-4460-8df5-1b4fd2dd189e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created volume successfully. Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-094f7638-7c19-449b-8897-aa8b57c122b7" returned: 0 in 0.555s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644" returned: 0 in 0.439s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] <== create_volume: return (1320ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.200s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759593334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89b62ec-6ff8-4071-b699-b125473b023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79285cb8f8a542c7bc9c8f05755effbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:27Z,use_quota=True,user_id='419a6a856f194edb95c39923413b5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Creating volume c89b62ec-6ff8-4071-b699-b125473b023e {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:33 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:08:33 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c89b62ec-6ff8-4071-b699-b125473b023e 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:33 devstack quobyte-client[82625]: System call of process 101213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:33 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=169, name=volume-c89b62ec-6ff8-4071-b699-b125473b023e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-094f7638-7c19-449b-8897-aa8b57c122b7" released by "delete_volume" :: held 2.151s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959953ec-5a2f-46a9-af2a-2424ebb1d234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982a8e33-85bb-4abb-919e-a3f1515c0641', 'volume_size': 1, 'image_id': '5ccd1e35-778d-4c33-8600-79b4a53291ea', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20de7718a6ec1b32b47087a7f486ed5f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1eebe4868e3b4d8cb1800d4ac6b6e9ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54abd6fb273ecc5ff7481380325b92514a8c31d1cecc1fe25ca8dc68cc71e72cd0572b7ce9241706dc7a938f38257a7b4c8de2fbd985c88c9593006d1c554d03', 'id': '5ccd1e35-778d-4c33-8600-79b4a53291ea', 'created_at': datetime.datetime(2025, 9, 10, 16, 7, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ccd1e35-778d-4c33-8600-79b4a53291ea/file', 'properties': {}}, 'image_service': }' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe76bb17-4ccc-4759-8bda-0f040f45f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebe2f96-58e1-41d3-a1dc-6da9034dca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d61a64-2c6c-4386-b7fd-c17823ad5959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c89b62ec-6ff8-4071-b699-b125473b023e 1073741824" returned: 0 in 0.505s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c89b62ec-6ff8-4071-b699-b125473b023e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:34 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644 (001cc020-c2a5-4dbe-bfd2-5c64a2fcb644): created successfully Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d61a64-2c6c-4386-b7fd-c17823ad5959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (8cc250cc-502f-405f-9bde-21b0c0fec2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:34 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Volume volume-982a8e33-85bb-4abb-919e-a3f1515c0641 (982a8e33-85bb-4abb-919e-a3f1515c0641): created successfully Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe76bb17-4ccc-4759-8bda-0f040f45f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Flow 'volume_create_manager' (d4c4851d-b587-4d30-b5c5-ed4f5bd9f105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-4960fd88-b8ed-4515-9c4c-173b2cb9d041 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created volume successfully. Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c89b62ec-6ff8-4071-b699-b125473b023e" returned: 0 in 0.438s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-a31a458a-8e15-4073-af64-89d7a28f8df5 tempest-VolumeImageDependencyTests-1547668682 None] Created volume successfully. Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] <== create_volume: return (971ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13913f4-af6c-432c-ae32-9db3b7fc14aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89b62ec-6ff8-4071-b699-b125473b023e', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9822020d-468b-475d-9880-b4b1cb036e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:34 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume volume-c89b62ec-6ff8-4071-b699-b125473b023e (c89b62ec-6ff8-4071-b699-b125473b023e): created successfully Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9822020d-468b-475d-9880-b4b1cb036e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Flow 'volume_create_manager' (8659e5db-bb1a-45b7-979e-c970a0ce5066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:34 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-941f58b4-f568-4ede-9ab2-f0a5597cb94d tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created volume successfully. Sep 10 18:08:34 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Created reservations ['eced87c9-b26d-4115-a01d-83704638b09b', '090678fc-0908-4229-b85c-d6d85b006745', '9d6f10ec-d33e-4787-b4fa-6c44a480711e', 'b7e4458f-c40b-4871-bba3-73548ae0545a'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Acquiring lock "cinder-982a8e33-85bb-4abb-919e-a3f1515c0641-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Lock "cinder-982a8e33-85bb-4abb-919e-a3f1515c0641-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:35 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Acquiring lock "cinder-quobyte-982a8e33-85bb-4abb-919e-a3f1515c0641" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.364s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:35 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Deleted volume successfully. Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Lock "cinder-quobyte-982a8e33-85bb-4abb-919e-a3f1515c0641" acquired by "delete_volume" :: waited 0.116s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d802d303-e3a4-49a7-bf4a-d9667954f31d tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-094f7638-7c19-449b-8897-aa8b57c122b7-delete_volume" released by "delete_volume" :: held 6.131s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa0130e-9b55-4097-b080-f3d0b1929bf7]: (4, 'raw') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:35 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-733f1b2c-b8ab-442c-b070-6baa93a0d54f-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-733f1b2c-b8ab-442c-b070-6baa93a0d54f-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:36 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "cinder-quobyte-733f1b2c-b8ab-442c-b070-6baa93a0d54f" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641" returned: 0 in 0.749s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-733f1b2c-b8ab-442c-b070-6baa93a0d54f" acquired by "delete_volume" :: waited 0.362s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c017d8-82ca-4019-a182-87e14ce432ab]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:36 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:37 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-quobyte-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641" returned: 1 in 0.747s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641' failed. Not Retrying. {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644" acquired by "delete_volume" :: waited 0.293s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-982a8e33-85bb-4abb-919e-a3f1515c0641" returned: 0 in 0.291s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b2c88-597a-4723-b31b-ea5e19923325]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Lock "cinder-quobyte-982a8e33-85bb-4abb-919e-a3f1515c0641" released by "delete_volume" :: held 2.037s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f" returned: 0 in 0.973s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:37 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:38 devstack quobyte-client[82625]: System call of process 101228 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-733f1b2c-b8ab-442c-b070-6baa93a0d54f" returned: 0 in 0.346s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644" returned: 0 in 0.794s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-quobyte-733f1b2c-b8ab-442c-b070-6baa93a0d54f" released by "delete_volume" :: held 1.778s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:38 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Created reservations ['fcb61d41-901a-43aa-9a1f-5d0b0beebf3b', 'b4bb682d-6e95-4b9c-ad3a-93c6e4274231', '09c1eb61-efa6-47d2-8624-655791364d07', 'f3affaf8-7a5e-4694-99bc-02324bb0e5c4'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:38 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644" returned: 0 in 0.412s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:38 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644" released by "delete_volume" :: held 1.337s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:38 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Created reservations ['44fce3fd-60a0-4f0f-8e5f-9bce6478ed4c', 'cd4cf15f-b9af-4d0f-96f7-8007e9b84566', '548c11d8-27c4-4f87-b1e5-3c5d765b08f0', '4f2980be-fd81-4cb6-bf83-8537999273ec'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created reservations ['700609fd-66f8-4f0e-a919-50161158231f', 'a9d52a90-0c47-464b-8113-07b2c676b078', 'b8cabc88-3acf-45ad-8ac0-e124fc083328', '20ee0081-a4ce-4d3e-a19e-0de74f12dbf2'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.363s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:39 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:39 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Deleted volume successfully. Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-c89b62ec-6ff8-4071-b699-b125473b023e-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.964s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-c89b62ec-6ff8-4071-b699-b125473b023e-delete_volume" acquired by "delete_volume" :: waited 0.478s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:40 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Deleted volume successfully. Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-47c2c26d-8fe0-4e50-bffc-19db86ebfd32 tempest-VolumeImageDependencyTests-1547668682 None] Lock "cinder-982a8e33-85bb-4abb-919e-a3f1515c0641-delete_volume" released by "delete_volume" :: held 5.529s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.527s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:40 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Deleted volume successfully. Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-472335d3-1ddb-4c9e-95ca-f91f98be1f91 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-001cc020-c2a5-4dbe-bfd2-5c64a2fcb644-delete_volume" released by "delete_volume" :: held 4.412s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-1107e34b-b9c1-4633-bd65-c7ef69d5e364 tempest-SnapshotDependencyTests-846578452 None] Lock "cinder-733f1b2c-b8ab-442c-b070-6baa93a0d54f-delete_volume" released by "delete_volume" :: held 4.680s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:40 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-quobyte-c89b62ec-6ff8-4071-b699-b125473b023e" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:40 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-c89b62ec-6ff8-4071-b699-b125473b023e" acquired by "delete_volume" :: waited 0.016s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:41 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[939ee706-2925-4432-8461-64743380da0e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c89b62ec-6ff8-4071-b699-b125473b023e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c89b62ec-6ff8-4071-b699-b125473b023e" returned: 0 in 0.652s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c89b62ec-6ff8-4071-b699-b125473b023e {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:41 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-c89b62ec-6ff8-4071-b699-b125473b023e" returned: 0 in 0.183s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-c89b62ec-6ff8-4071-b699-b125473b023e" released by "delete_volume" :: held 1.036s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created reservations ['acb08057-4655-4809-bd60-96b21f08c31d', '92042d01-bd63-4162-a2e8-7089dc2bfae4', 'f81a260f-8879-4db8-b392-9a89a5cd2741', 'c3ad7ea7-813d-4f54-b533-383570c87e8c'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.198s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:42 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:43 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Deleted volume successfully. Sep 10 18:08:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-653c4923-c594-4631-95ae-ae9a4181830e tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-c89b62ec-6ff8-4071-b699-b125473b023e-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-212ba53e-f9b8-49e9-87dc-d6803af44ddc-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-212ba53e-f9b8-49e9-87dc-d6803af44ddc-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:43 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-quobyte-212ba53e-f9b8-49e9-87dc-d6803af44ddc" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:43 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-212ba53e-f9b8-49e9-87dc-d6803af44ddc" acquired by "delete_volume" :: waited 0.022s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:43 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2239850-81f2-493b-93e4-4c2647b0237c]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:43 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc" returned: 0 in 0.456s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-212ba53e-f9b8-49e9-87dc-d6803af44ddc" returned: 0 in 0.100s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-212ba53e-f9b8-49e9-87dc-d6803af44ddc" released by "delete_volume" :: held 0.747s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created reservations ['c3ec2841-f02a-43e4-a69b-c5163ba6f722', '58fe158a-1e94-41a5-974e-86a1ffffc715', 'a75154e0-c51c-433b-bb4d-f3b31992287d', '328d8b67-3d8e-4e72-90b7-36f099f823b2'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:44 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:45 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.211s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:45 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:45 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Deleted volume successfully. Sep 10 18:08:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-e17b1a0f-fe92-45ed-95b0-97c3c3eab379 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-212ba53e-f9b8-49e9-87dc-d6803af44ddc-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-f7b0a643-ba74-4a54-912c-75998938fcff-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:45 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-f7b0a643-ba74-4a54-912c-75998938fcff-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:46 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:46 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-quobyte-f7b0a643-ba74-4a54-912c-75998938fcff" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:46 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-f7b0a643-ba74-4a54-912c-75998938fcff" acquired by "delete_volume" :: waited 0.025s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:46 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccab10f-247a-4a9c-9c11-93ac12ba0a05]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7b0a643-ba74-4a54-912c-75998938fcff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7b0a643-ba74-4a54-912c-75998938fcff" returned: 0 in 0.454s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7b0a643-ba74-4a54-912c-75998938fcff {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:46 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-f7b0a643-ba74-4a54-912c-75998938fcff" returned: 0 in 0.125s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:46 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-f7b0a643-ba74-4a54-912c-75998938fcff" released by "delete_volume" :: held 0.796s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created reservations ['0e6a086f-c5b4-4187-844b-ae12dd990c2c', '20368a50-e0dc-40c9-98a9-9944aa2029ee', '87db389b-42c6-40cb-ab88-b438dd25b817', 'd09407de-a318-404c-8133-96d924d793d4'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.109s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:47 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:47 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Deleted volume successfully. Sep 10 18:08:48 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-435176d1-a659-42f5-bff4-36e74761621b tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-f7b0a643-ba74-4a54-912c-75998938fcff-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-a6730618-96fb-4f24-a23d-7fb3c2fca9d3-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-a6730618-96fb-4f24-a23d-7fb3c2fca9d3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:49 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-quobyte-a6730618-96fb-4f24-a23d-7fb3c2fca9d3" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:49 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-a6730618-96fb-4f24-a23d-7fb3c2fca9d3" acquired by "delete_volume" :: waited 0.018s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:49 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ac445a-93d2-484c-a4e1-42d17d1a7ee9]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3" returned: 0 in 0.455s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:49 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-a6730618-96fb-4f24-a23d-7fb3c2fca9d3" returned: 0 in 0.094s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-a6730618-96fb-4f24-a23d-7fb3c2fca9d3" released by "delete_volume" :: held 0.730s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created reservations ['d9058542-67af-46e3-ae87-b822fc1c2f29', '5f886d4e-e296-4747-aa5e-3a7aa67f9147', '439a1973-0225-4f5c-9f2b-f7b5c0e9813e', '9eb4246e-64b4-4bd4-9d5a-187246596d7b'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.156s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:50 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:51 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Deleted volume successfully. Sep 10 18:08:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-0d736a03-6fa8-43b8-a4e6-ff3f84c6e804 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-a6730618-96fb-4f24-a23d-7fb3c2fca9d3-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-932344de-3526-40ad-ab56-b0b8f1b65ff8-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-932344de-3526-40ad-ab56-b0b8f1b65ff8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:51 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "cinder-quobyte-932344de-3526-40ad-ab56-b0b8f1b65ff8" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:08:51 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-932344de-3526-40ad-ab56-b0b8f1b65ff8" acquired by "delete_volume" :: waited 0.015s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:08:51 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e72ae25-80ad-41f6-b0a6-140ba03503d7]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:08:51 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-932344de-3526-40ad-ab56-b0b8f1b65ff8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:52 devstack quobyte-client[82625]: System call of process 101263 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:08:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-932344de-3526-40ad-ab56-b0b8f1b65ff8" returned: 0 in 0.654s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-932344de-3526-40ad-ab56-b0b8f1b65ff8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:52 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-932344de-3526-40ad-ab56-b0b8f1b65ff8" returned: 0 in 0.135s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:52 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-quobyte-932344de-3526-40ad-ab56-b0b8f1b65ff8" released by "delete_volume" :: held 1.075s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Created reservations ['d7724904-9e0b-401e-a373-4b4e88455523', '1d2b87a5-0c61-4454-800b-7f691921753b', 'a9c966ad-bac0-4823-b06a-5098c3356eb8', '20bf23b4-51c7-4080-ad0e-ae93c4eb5f53'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.156s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:53 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:08:54 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Deleted volume successfully. Sep 10 18:08:54 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-d76fdc29-c41c-4c7a-bc48-561e7a5b6a95 tempest-CreateVolumesFromSourceVolumeTest-1929542021 None] Lock "cinder-932344de-3526-40ad-ab56-b0b8f1b65ff8-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:08:58 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Flow 'volume_create_manager' (42ff3b15-11b7-4128-a728-9d3f9cb7b441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc08bb9f-5f50-4c13-9533-d62f86e97b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc08bb9f-5f50-4c13-9533-d62f86e97b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de780db3-2e17-4b3f-8cf7-87ed303ef6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2e9975e9864ce8bc7757b0942e92ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:58Z,use_quota=True,user_id='1c446283ec114fcca00d7d43bca958fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71d8772-97b8-4014-9707-c1f94a6d5fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71d8772-97b8-4014-9707-c1f94a6d5fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ef9dd8-9833-4306-9259-2df20fa664a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ef9dd8-9833-4306-9259-2df20fa664a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de780db3-2e17-4b3f-8cf7-87ed303ef6c8', 'volume_name': 'volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e415d78f-506f-4ec2-8329-0e6f48906b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e415d78f-506f-4ec2-8329-0e6f48906b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50a0153-6b5a-4d77-b1fe-82cb9349e49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:58 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Volume de780db3-2e17-4b3f-8cf7-87ed303ef6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8', 'volume_size': 1} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de780db3-2e17-4b3f-8cf7-87ed303ef6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2e9975e9864ce8bc7757b0942e92ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:08:58Z,use_quota=True,user_id='1c446283ec114fcca00d7d43bca958fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Creating volume de780db3-2e17-4b3f-8cf7-87ed303ef6c8 {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:08:58 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:08:58 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:58 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=170, name=volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8 1073741824" returned: 0 in 0.361s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8" returned: 0 in 0.097s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] <== create_volume: return (551ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.563s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50a0153-6b5a-4d77-b1fe-82cb9349e49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993c91e6-4e9d-4fb5-82fd-d8ed75afbed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:08:59 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Volume volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8 (de780db3-2e17-4b3f-8cf7-87ed303ef6c8): created successfully Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993c91e6-4e9d-4fb5-82fd-d8ed75afbed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:08:59 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Flow 'volume_create_manager' (42ff3b15-11b7-4128-a728-9d3f9cb7b441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:08:59 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-e56b5a07-a288-48ee-b4a9-3cdaa532703b tempest-CinderUnicodeTest-756392829 None] Created volume successfully. Sep 10 18:09:01 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.flows.manager.create_volume [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82609) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Flow 'volume_create_manager' (d16fbafe-00ac-4bc6-be3c-14a37a2ac027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472e0ab7-2d33-4a60-b513-f4e8af858099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472e0ab7-2d33-4a60-b513-f4e8af858099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:09:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-697017006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=523d43a4-53e8-4ab2-b64e-b0f2aae29a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2e9975e9864ce8bc7757b0942e92ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:09:01Z,use_quota=True,user_id='1c446283ec114fcca00d7d43bca958fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e436aa9a-96de-4326-8624-657fb17594c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e436aa9a-96de-4326-8624-657fb17594c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a572c2-d8dc-47df-a2ad-7c49f78749ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a572c2-d8dc-47df-a2ad-7c49f78749ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '523d43a4-53e8-4ab2-b64e-b0f2aae29a8f', 'volume_name': 'volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c046f-193a-4661-a8cb-7b0daf3421b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c046f-193a-4661-a8cb-7b0daf3421b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2783fc-3c47-4a57-a476-823b6cf9be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:09:01 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Volume 523d43a4-53e8-4ab2-b64e-b0f2aae29a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f', 'volume_size': 1} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T16:09:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-697017006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=523d43a4-53e8-4ab2-b64e-b0f2aae29a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2e9975e9864ce8bc7757b0942e92ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T16:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T16:09:01Z,use_quota=True,user_id='1c446283ec114fcca00d7d43bca958fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca474753-c76b-470d-951f-b55d58b93964),volume_type_id=ca474753-c76b-470d-951f-b55d58b93964)}" {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Creating volume 523d43a4-53e8-4ab2-b64e-b0f2aae29a8f {{(pid=82609) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Selected 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 as target Quobyte volume. {{(pid=82609) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 18:09:01 devstack cinder-volume[82609]: INFO cinder.volume.drivers.remotefs [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] casted to 10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474 Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f 1073741824 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:01 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=171, name=volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f 1073741824" returned: 0 in 0.303s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" returned: 0 in 0.102s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] <== create_volume: return (468ms) {'provider_location': '10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'} {{(pid=82609) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.480s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2783fc-3c47-4a57-a476-823b6cf9be43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f', 'volume_size': 1}' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58db1308-b40d-4e4a-981c-69d6a05e1949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 18:09:01 devstack cinder-volume[82609]: INFO cinder.volume.flows.manager.create_volume [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Volume volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f (523d43a4-53e8-4ab2-b64e-b0f2aae29a8f): created successfully Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58db1308-b40d-4e4a-981c-69d6a05e1949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82609) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 18:09:01 devstack cinder-volume[82609]: DEBUG cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Flow 'volume_create_manager' (d16fbafe-00ac-4bc6-be3c-14a37a2ac027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82609) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 18:09:01 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-8926d06d-68b3-4d31-8ed2-ac219fdfa81c tempest-CinderUnicodeTest-756392829 None] Created volume successfully. Sep 10 18:09:02 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:09:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:09:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:09:02 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Creating offline snapshot dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 of volume 523d43a4-53e8-4ab2-b64e-b0f2aae29a8f {{(pid=82609) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 18:09:02 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc18e1f2-76bb-4b35-bd82-9875afc2bcca]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:09:02 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" returned: 0 in 0.383s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 1G {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:03 devstack quobyte-client[82625]: The server volume:da322b66-fd1f-4ab1-a4b0-9f584ec683ba@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=da322b66-fd1f-4ab1-a4b0-9f584ec683ba, inode=172, name=volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.66), requestorAccessMask=0 Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 1G" returned: 0 in 0.245s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): qemu-img rebase -u -b volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] CMD "qemu-img rebase -u -b volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f -F qcow2 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" returned: 0 in 0.134s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" returned: 0 in 0.085s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Setting permissions: /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f -> 1000:1000 {{(pid=82609) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" returned: 0 in 0.103s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.info" returned: 0 in 0.089s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] File path /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.info is being set with permissions: 660 {{(pid=82609) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 18:09:03 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.info {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.info" returned: 0 in 0.083s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.439s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:09:04 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-cc34859e-7079-421e-9ca9-b7835dfdeca5 tempest-CinderUnicodeTest-756392829 None] Create snapshot completed successfully Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Acquiring lock "cinder-dd3885fe-8ef9-4e5b-8531-c9cd2055cd44-delete_snapshot" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Lock "cinder-dd3885fe-8ef9-4e5b-8531-c9cd2055cd44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:09:04 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Acquiring lock "cinder-quobyte-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" by "delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Lock "cinder-quobyte-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Acquiring lock "cinder-quobyte-dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" by "_delete_snapshot" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Lock "cinder-quobyte-dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Deleting offline snapshot dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 of volume 523d43a4-53e8-4ab2-b64e-b0f2aae29a8f {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] snapshot_file for this snap is: volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 {{(pid=82609) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf493ad-864f-4f00-9025-af73acb840bf]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:09:04 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:05 devstack quobyte-client[82625]: System call of process 101303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:09:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" returned: 0 in 0.525s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:05 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.remotefs [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82609) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 18:09:05 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f02bc1-ba66-4571-8d4e-09e685200d35]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:09:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" returned: 0 in 0.442s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:05 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:05 devstack quobyte-client[82625]: System call of process 101331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 18:09:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" returned: 0 in 0.189s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:06 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f.dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" returned: 0 in 0.096s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Lock "cinder-quobyte-dd3885fe-8ef9-4e5b-8531-c9cd2055cd44" released by "_delete_snapshot" :: held 1.589s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:09:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Lock "cinder-quobyte-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" released by "delete_snapshot" :: held 1.627s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:09:06 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Created reservations ['4ffe7357-351b-4b48-a596-99f82e28b51e', '0b4fc43e-a5a2-4cd9-993b-2c3d0418f254', 'dcc4129a-d69b-4850-bca5-b06e81577c62', '0f34a18b-9cbb-432b-b3d6-183ee45c99ea'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:09:06 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Delete snapshot completed successfully. Sep 10 18:09:06 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-cc1f4e7a-7f36-4ed7-9603-c55d4b5080db tempest-CinderUnicodeTest-756392829 None] Lock "cinder-dd3885fe-8ef9-4e5b-8531-c9cd2055cd44-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Acquiring lock "cinder-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Lock "cinder-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:09:08 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Acquiring lock "cinder-quobyte-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Lock "cinder-quobyte-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" acquired by "delete_volume" :: waited 0.012s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[39067872-8c98-4615-986d-70fe6b8a9fbe]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" returned: 0 in 0.403s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" returned: 0 in 0.085s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:08 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Lock "cinder-quobyte-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f" released by "delete_volume" :: held 0.654s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Created reservations ['240388c1-590e-4277-9929-675c69dd34fa', 'd186fdb4-9eea-43e7-9152-6a87f2f75af4', '7de18da6-0c96-4ee2-b8f9-e941eec54d83', '6cd74c76-0fb4-4387-8391-6d8b5bd63bce'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Acquiring lock "cinder-de780db3-2e17-4b3f-8cf7-87ed303ef6c8-delete_volume" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.350s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Lock "cinder-de780db3-2e17-4b3f-8cf7-87ed303ef6c8-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:09:09 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Deleted volume successfully. Sep 10 18:09:09 devstack cinder-volume[82609]: WARNING cinder.volume.volume_utils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Acquiring lock "cinder-quobyte-de780db3-2e17-4b3f-8cf7-87ed303ef6c8" by "delete_volume" {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-35aee729-0671-4904-a5b7-722887b3af86 tempest-CinderUnicodeTest-756392829 None] Lock "cinder-523d43a4-53e8-4ab2-b64e-b0f2aae29a8f-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Lock "cinder-quobyte-de780db3-2e17-4b3f-8cf7-87ed303ef6c8" acquired by "delete_volume" :: waited 0.020s {{(pid=82609) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07600ed-3e91-4659-bd6f-30ef56f7284e]: (4, 'qcow2') {{(pid=84325) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 18:09:09 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8" returned: 0 in 0.386s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] CMD "rm -f /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0/volume-de780db3-2e17-4b3f-8cf7-87ed303ef6c8" returned: 0 in 0.117s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Lock "cinder-quobyte-de780db3-2e17-4b3f-8cf7-87ed303ef6c8" released by "delete_volume" :: held 0.658s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:DELETE=9,cinder:SELECT=77,cinder:UPDATE=108,cinder:INSERT=22 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG cinder.quota [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Created reservations ['e7848cdf-af78-46cc-b9a2-09abbdecec80', '4f383d59-e1fd-4e9b-8ee9-5d12f7f79a4b', 'abc29c42-55c4-4668-9b33-7e43afb88606', '5e399ba5-98e4-44d6-848d-cdf771349d69'] {{(pid=82609) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:09:10 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:11 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.129s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:11 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:09:11 devstack cinder-volume[82609]: INFO cinder.volume.manager [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Deleted volume successfully. Sep 10 18:09:11 devstack cinder-volume[82609]: DEBUG cinder.coordination [None req-9efdfb9f-b5c9-4857-ba3e-732ea0fbc96a tempest-CinderUnicodeTest-756392829 None] Lock "cinder-de780db3-2e17-4b3f-8cf7-87ed303ef6c8-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82609) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 18:09:20 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=125,cinder:DELETE=13,cinder:SELECT=79,cinder:INSERT=38 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:09:21 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:UPDATE=8,cinder:SELECT=1,cinder:DELETE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG oslo_service.periodic_task [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82609) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474': None} {{(pid=82609) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG cinder.volume.drivers.quobyte [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Available shares ['10.10.41.181/cinder-vol-533cc80f-8a36-45fb-86b1-48869507c474'] {{(pid=82609) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.lockutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82609) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0 {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG oslo_concurrency.processutils [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f89c2a1fcd118eccea817141be29cf0" returned: 0 in 0.124s {{(pid=82609) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 18:09:28 devstack cinder-volume[82609]: DEBUG cinder.manager [None req-d2fffac4-a7cf-4fb7-991f-74329cb953b6 None None] Notifying Schedulers of capabilities ... {{(pid=82609) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 18:09:31 devstack cinder-volume[82609]: DEBUG dbcounter [-] [82609] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82609) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}